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COM MISSION ER'S 

STATEMENT 



The Third International Mathematics and Science Study (TIMSS) is the largest, most 
comprehensive, and most rigorous international study of schools and student 
achievement ever conducted. This report. Pursuing Excellence: A Study ofU.S. Twelfth- 
Grade Mathematics and Science Achievement in International Context, compares the gen- 
eral mathematics and science knowledge of our students in their last year of sec- 
ondary school with those of 20 other countries, as well as the achievement of our stu- 
dents taking physics and advanced mathematics courses with those in 15 other coun- 
tries. It is the last of three major TIMSS reports by the National Center for Education 
Statistics (NCES) in its Pursuing Excellence The first report, outlining U.S. com- 
parative eighth-grade results, was released in November 1996, and the second report, 
detailing fourth-grade results, was released in June 1997. Together, these three stud- 
ies paint the most complete picture ever of how achievement in mathematics and sci- 
ence by U.S. students compares with that of other nations. The information is 
intended to help U.S. educators, parents, policymakers, and others evaluate the 
strengths and weaknesses of our schools from an international perspective. This com- 
parative portrait can be used to examine our education system, scrutinize improve- 
ment plans, and evaluate proposed standards and curricula. 

The scope of TIMSS is unprecedented in, the annals of education research. The 
international project involved the testing of more than one-half million students in 
mathematics and science at three grade levels in 41 countries. In contrast to previ- 
ous international comparative studies^ TIMSS also goes beyond the traditional 
“horserace” data on student performance to explore possible causes for differences 
in achievement including questions on students’ lives inside and outside of the class- 
room. 

This wealth of data is being analyzed and published by NCES and others around the 
world. TIMSS has become the most accessible international education study ever by 
releasing information in a variety of new forms, including CD-ROM, videotape, and 
the World Wide Web (http://nces.ed.gov/timss). We invite everyone who is dedicat- 
ed to enhancing the quality of our nation's mathematics and science education to 
make the fullest possible use of this rich resource. 

Together, the various TIMSS reports constitute important tools that can improve the 
quality of primary and secondary education for all students. That is why the Center 
has worked cooperatively with other parts of the U.S. Department of Education to 
produce a multi-media resource kit designed for educators and those interested in 
using TIMSS data to improve teaching, curricula, and student achievement in states 
and local communities. We also will be conducting a follow-up study in 1999, when 
the students who took TIMSS in the fourth grade have reached the eighth grade, 
both to compare their performance with the 1995 eighth-grade results, and to assess 
the level of progress made by this group of students over the intervening four years. 
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The TIMSS data provide a reference point from which we can begin to clarify what 
we mean by “world-class” education. They give us tools by which we can benchmark 
not only the performance of our students but also the way in which we deliver 
instruction. Most importandy, they allow the U.S. to learn unique lessons from other 
members of the world community so that we may better pursue the goal of an 
excellent education for all students. 




Pascal D. Forgione,Jr. 

Commissioner of Education Statistics 



February 1998 
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NSF . DIRECTO R'S 
STATEMENT 



The Third International Mathematics and Science Study (TIMSS) was designed 
explicidy to enable educators and policy makers to compare achievement in science 
and mathematics of students in the United States with those in other countries at 
three levels of education, grades 4, 8, and the final year of secondary school (grade 
12 in the U.S.). With this publication of the results of the 1995 assessment of the 
final year of secondary school, TIMSS has been successful. In addition, differences 
in student learning and characteristics of schooling, as measured by the TIMSS 
assessment instruments and questionnaires, enhance our understanding of the pos- 
sible influences of such factors as school organization, teaching practices, student 
study habits, and family background. But the secrets of raising the level of student 
achievement beyond their current levels are not readily uncovered, and this study 
provides no easy answers or quick fixes. 

The results of students in the final year of secondary school in the TIMSS science and 
mathematics general knowledge assessments found that our students performed less 
well than they did at grade 8, significandy below the international mean. In addi- 
tion, U.S. most advanced students (those taking pre-calculus or calculus and those 
taking physics) performed at low levels in advanced mathematics and at especially 
low levels in physics when compared with similar students in other countries. 

Once the results for all grades are considered, we see that U.S. students in the early 
school years have reasonable levels of achievement when compared with other coun- 
tries — in science they are actually rated near the top — but performance lags by grade 
8 and becomes even poorer at grade 12. The report’s new information about 
advanced students should be reviewed carefully by college and university policy 
makers as well as those who influence coursetaking and career decisions made 
during the high school years. 

Results of the advanced mathematics test reveal some unexpected weaknesses. 
Despite the fact that about one-quarter of the test related to calculus and that one- 
half of the U.S. advanced mathematics students were actually studying calculus, it was 
in geometry, not calculus, where U.S. students performed worst. This is consistent 
with performance in grades 4 and 8, but unexpected because these advanced 
students have all had formal geometry coursework. The results show that both 
geometry and algebra need to be key subjects of study throughout the curriculum. 

For me, as a physicist with a keen interest in education, the science results are even 
more troubling. Students performed poorly in most sub-areas of physics, with the 
poorest performance coming on items on mechanics and electricity/magnetism 
(areas that account for about 75 percent of American physics textbooks). Even 
students who took an Advanced Placement physics course scored below the interna- 
tional norm. 

These studies suggest that students appear to disengage from learning critical 
mathematics and science content as they progress through the school system. The 
sources of disengagement may include the classroom environment, the quality of 
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instruction, and parental and community support for the value of science and 
mathematics to our children’s future. 



Improving achievement in mathematics and science subjects, whether in basic skills 
or advanced critical thinking, will require that students have, in combination, access 
to good teachers, good teaching materials, and agreement within the school on the 
goals of learning for all students. There are many efforts underway in states and 
localities throughout the United States to reform the process of teaching and learn- 
ing mathematics and science. They are beginning to reveal mechanisms for obtain- 
ing gains in achievement. TIMSS also provides us with examples of nations with high 
performance at all grade levels, most notably Canada, the Netherlands, and Switzer- 
land. American educators need to examine these successful efforts, learn from 
them, and effectively use all available resources to improve teaching and learning in 
mathematics and science at all grade levels. 




Neal Lane, Director 
National Science Foundation 



February 1998 
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EXECUTIVE 



SUMMARY 



INTRODUCTION 

■ The Third International Mathematics 
and Science Study (TIMSS) is the 
largest, most comprehensive, and 
most rigorous international compari- 
son of education ever undertaken. 
During 1995, the study assessed the 
mathematics and science knowledge 
of a half-million students from 41 
nations at three levels of schooling. 

■ The information in this report is 
about students who were assessed at 
the end of twelfth grade in the United 
States and at the end of secondary 
education in other countries. It 
includes four areas of performance: 
mathematics general knowledge, sci- 
ence general knowledge, physics, and 
advanced mathematics. 

■ This report on students in the final 
year of secondary school is the last in 
a series of three public-audience 
reports titled Pursuing Excellence. The 
first report presented findings on stu- 
dent achievement at eighth grade. 
The second report presented find- 
ings from the fourth grade. 

■ TIMSS is a fair and accurate compar- 
ison of mathematics and science 
achievement in the participating 
nations. The students who participat- 
ed in TIMSS were scientifically select- 
ed to accurately represent students in 
their respective nations. The entire 
assessment process was scrutinized by 
international technical review com- 
mittees to ensure its adherence to 
established standards. Those nations 
in which irregularities arose, includ- 
ing the United States, are clearly 
noted in this and other TIMSS 
reports. 



■ Criticisms of previous international 
studies comparing students near the 
end of secondary school are not valid 
for TIMSS. Because the high enroll- 
ment rates for secondary education 
in the United States are typical of 
other TIMSS countries, our general 
population is not being compared to 
more select groups in other coun- 
tries. Further, the strict quality con- 
trols ensured that the sample of stu- 
dents taking the general knowledge 
assessments was representative of all 
students at the end of secondary 
school, not just those in academical- 
ly-oriented programs. 

■ This report consists of three parts: ini- 
tial findings from the assessments of 
mathematics and of science general 
knowledge; initial findings from 
assessments of physics and of 
advanced mathematics; and initial 
findings about school systems and stu- 
dents' lives; and how those are associ- 
ated with the relative performance of 
U.S. students compared to those in 
other cultures. 



ACHIEVEMENT OF ALL STUDENTS 

■ A sample of all students at the end of 
secondary school (twelfth grade in 
the United States) was assessed in 
mathematics and science general 
knowledge. Mathematics general knowl- 
edge and science general knowledge 
are defined as the knowledge of 
mathematics and of science needed 
to function effectively in society as 
adults. 

■ U.S. twelfth graders performed 
below the international average and 
among the lowest of the 21 TIMSS 
countries on the assessment of 
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mathematics general knowledge. U.S. 
students were outperformed by those 
in 14 countries, and outperformed 
those in 2 countries. Among the 21 
TIMSS nations, our students’ scores 
were not significantly different from 
those in 4 countries. 

U.S. twelfth graders also performed 
below the international average and 
among the lowest scoring of the 21 
TIMSS countries on the assessment of 
science general knowledge. U.S. stu- 
dents were outperformed by students 
in 11 countries. U.S. students outper- 
formed students in 2 countries. Our 
students’ scores were not significantly 
different from those of 7 countries, 
including France, Germany, Italy, and 
the Russian Federation. 

The international standing of U.S. 
students was stronger at the eighth 
grade than at the twelfth grade in 
both mathematics and science 
among the countries that participat- 
ed in the assessments at both grade 
levels. 

The U.S. international standing on 
the general knowledge component 
of TIMSS was higher in science than 
in mathematics. This pattern is simi- 
lar to the findings at fourth and 
eighth grades in TIMSS. 

The U.S. was one of three countries 
that did not have a significant gender 
gap in mathematics general knowl- 
edge among students at the end of 
secondary schooling. While there was 
a gender gap in science general 
knowledge in the United States, as in 
every other TIMSS nation except 



one, the U.S. gender gap was one of 
the smallest. 



ACHIEVEMENT OF ADVANCED 
STUDENTS 

H The advanced mathematics assess- 
ment was administered to students 
who had taken or were taking pre-cal- 
culus, calculus, or AP calculus in the 
United States and to advanced math- 
ematics students in other countries. 
The physics assessment was adminis- 
tered to students in the United States 
who had taken or were taking physics 
or AP physics and to advanced sci- 
ence students in other countries. 

H Performance of U.S. physics and 
advanced mathematics students was 
among the lowest of the 16 countries 
which administered the physics and 
advanced mathematics assessments. 
In physics, 14 countries outper- 
formed the United States; no 
countries performed more poorly. In 
advanced mathematics, 11 countries 
outperformed the United States and 
no countries performed more poorly. 

■ In all five content areas of physics 
and in all three content areas of 
advanced mathematics, U.S. physics 
and advanced mathematics students’ 
performance was among the lowest 
of the TIMSS nations. 

■ In both physics and advanced mathe- 
matics, males outperformed females 
in the United States and most of the 
other TIMSS countries. 




■ More countries outperformed the 
United States in physics than in 
advanced mathematics. This differs 
from the results for mathematics and 
science general knowledge, as well as 
the results at grades 4 and 8, where 
more countries outperformed the 
United States in mathematics than in 
science. 

CONTEXTS OF LEARNING 

■ It is too early in the process of data 
analysis to provide strong evidence to 
suggest factors that may be related to 
the patterns of performance at the 
end of secondary schooling 
described here. 

■ Although secondary education in the 
United States differs structurally in 
important dimensions from that in 
many of the other countries, in this 
first analysis, few of those structural 
differences are clearly related to the 
relatively poor performance of our 
twelfth graders on the TIMSS assess- 
ments. 

■ Although the lives of U.S. graduating 
students differ from those of their 
peers in other countries on several of 
the factors examined, few appear to 
be systematically related to our per- 
formance in twelfth grade compared 
to the other countries participating 
in TIMSS. 



H Further analyses are needed to pro- 
vide more definitive insights on these 
subjects. 

CONCLUSIONS 

a U.S. students’ performance was 
among the lowest of the participating 
countries in mathematics and science 
general knowledge, physics, and 
advanced mathematics. 

■ TIMSS does not suggest any single 
factor or combination of factors that 
can explain why our performance at 
twelfth grade is low relative to other 
countries at the end of secondary 
education. 

B From our initial analyses, it also 
appears that some factors commonly 
thought to be related to individual 
student performance are not strongly 
related to national averages of 
student performance at the end of 
secondary school in TIMSS. 

ffl TIMSS provides a rich source of 
information about student perfor- 
mance in mathematics and science, 
and about education in other coun- 
tries. These initial findings suggest 
that to use the study most effectively, 
we need to pursue the data beyond 
this initial report, taking the oppor- 
tunity and time to look at interrela- 
tionships among factors in greater 
depth. 
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The Third International Mathematics 
and Science Study (TIMSS) is the largest 
and most comprehensive comparative 
international study of education that has 
ever been undertaken. TIMSS in the 
United States was coordinated by the 
National Center for Education Statistics 
(NCES) and the National Science Foun- 
dation (NSF). The study assessed a half- 
million students from 41 countries in 30 
languages to compare their mathemat- 
ics and science achievement. This report 
focuses on the 23 countries that partici- 
pated in the TIMSS study of students at 
the end of secondary education. 

TIMSS comes at a time when mathemat- 
ics and science achievement has been 
designated as an educational priority. 
One of our eight current National Edu- 
cation Goals is that “by the year 2000, 
the United States will be first in the 
world in mathematics and science 
achievement.” In addition, mathematics 
and science experts have issued major 
calls for reform in the teaching of their 
subjects. The National Council of Teach- 
ers of Mathematics published Curricu- 
lum and Evaluation Standards for School 
Mathematics^ in 1989, and Professional 
Standards for Teaching Mathematic^ in 
1991. In 1993, the American Association 
for the Advancement of Science fol- 
lowed suit with Benchmarks for Science Lit- 
eracy,^ and in 1996, the National Acade- 
my of Sciences published National Sci- 
ence Education Standards.^ 

This is the last of three reports in 
the Pursuing Excellence series. The first 
report presented initial findings on the 
eighth grade and was released in 
November, 1996. The second report pre- 
sented findings on the fourth grade and 
was released in June, 1997. This report 
presents initial findings about the inter- 
national standing of the United States’ 



twelfth graders relative to students com- 
pleting secondary school in other coun- 
tries. It is based on the comparative data 
published in the report. Mathematics and 
Science Achievement in the Final Year of Sec- 
ondary School: lEA's Third International 
Mathematics and Science StudyA The 
TIMSS International Study Center at 
Boston College will release complete 
data files for the study later this year, 
which will allow a more extensive exam- 
ination of student performance in math- 
ematics and science in the participating 
countries. 

WHAT IS TIMSS? 

TIMSS is the third comparison of 
mathematics achievement and third 
comparison of science achievement 
carried out by the International 
Association for the Evaluation of 
Educational Achievement (lEA). 
Previous lEA studies of mathematics and 
science were conducted for each subject 
separately at various times during the 
1960s, 1970s, and 1980s. TIMSS is the 
first lEA study that has assessed both 
mathematics and science at the same 
time. Comparative studies of other 
subjects, including reading literacy 
(1992)® and computers in education 
(1993),’ have also been published by the 
lEA. 

TIMSS was designed to focus on students 
at three different stages of schooling: 
midway through elementary school, mid- 
way through lower secondary school, and 
at the end of upper secondary school. Ini- 
tial findings for the 41 countries in the 
lower secondary school component® and 
for the 26 countries that participated in 
the elementary school component^ are 
reported in earlier volumes of the 
fhirsuing Excellence series. This report pre- 
sents initial findings for the 23 countries 
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in the remaining component of TIMSS, 
students at the end of secondary educa- 
don. Findings are presented for four 
broad areas of performance: 

0 Mathemadcs general knowledge"^ for 
all students in the final year of sec- 
ondary education, including those 
who had taken advanced courses as 
well as those who had not; 

□ Science general knowledge^ for all 
students in the final year of sec- 
ondary educadon, including those 
who had taken advanced science 
courses as well as those who had not; 

□ Advanced mathematics for students 
in the final year of secondary educa- 
don who had taken or were taking 
advanced courses in mathematics; 
and 

0 Physics for students in the final year 
of secondary education who had 
taken or were taking physics. 

For the assessments of mathematics 
general knowledge and science general 
knowledge, this report presents results 
for 21 countries: Australia, Austria, 
Canada, Cyprus, the Czech Republic, 
Denmark, France, Germany, Hungary, 
Iceland, Italy, Lithuania, the Nether- 
lands, New Zealand, Norway, the 
Russian Federation, Slovenia, South 
Africa, Sweden, Switzerland, and the 
United States. 

For the assessment of advanced 
mathematics, results are reported for 16 
countries: Australia, Austria, Canada, 



Cyprus, the Czech Republic, Denmark, 
France, Germany, Greece, Italy, Lithua- 
nia, the Russian Federation, Slovenia, 
Sweden, Switzerland, and the United 
States. 

For the physics assessment, results are 
reported for 16 countries: Australia, 
Austria, Canada, Cyprus, the Czech 
Republic, Denmark, France, Germany, 
Greece, Latvia, Norway, the 
Russian Federation, Slovenia, Sweden, 
Switzerland, and the United States. 

The elementary and middle school 
components of TIMSS defined eligible 
students primarily on the basis of age. 
The elementary school group included 
students enrolled in the pair of adjacent 
grades that contained the most 9-year- 
olds, grades 3 and 4 in the United States 
and most other countries. The middle 
school students were in the pair of 
grades that contained the most 13-year- 
olds, grades 7 and 8 in the United States 
and most other countries. 

A major goal of the end of secondary 
school component of TIMSS was to 
measure what students know by the time 
they leave the secondary school system. 
Because countries have different struc- 
tures for secondary education, the final 
grade of secondary education in the 
countries participating in TIMSS may be 
as low as 9 and as high as 14, depending 
on the country and program in which 
the student is enrolled. For the United 
States, the final year of secondary edu- 
cation is grade 12, and twelfth-grade stu- 
dents were selected for the study. All 
twelfth graders were eligible for the 



The terms “mathematics general knowledge” and “science general knowledge" used throughout this 
report are equivalent to the terms “mathematics literacy” and “science literacy” used in the interna- 
tional report on achievement in the final year of secondary school published by Boston College. 
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mathematics and science general 
knowledge portion of the study. 
Advanced mathematics students in the 
United States were defined as twelfth 
graders who had taken or were taking a 
full year of a high school course that 
included the word “calculus” in the title, 
including pre-calculus. Physics students 
were twelfth graders who had taken or 
were taking at least one full year of high 
school physics. Appendix 1 provides 
information about how other countries 
identified students to participate in the 
study. 

Students in both public and private 
schools were administered the 
mathematics and science general 
knowledge assessments, which together 
were about 1.5 hours in length, and 
included both multiple-choice and free- 
response items. In each country, the 
items were translated into the primary 
languages of instruction. In the United 
States, all assessments were adminis- 
tered in English. Testing occurred 2 to 3 
months before the end of the 1994-95 
school year. Students with special needs 
and disabilities that would make it diffi- 
cult for them to take the assessments 
were excused. Students were allowed to 
use calculators for all assessments. 

Like the other components of TIMSS, 
participating countries collected data 
beyond the student assessments. 
Students completed questionnaires 
about their experiences in and out of 
school. School administrators complet- 
ed questionnaires about school policies 
and practices. An exploratory curricu- 
lum analysis compared mathematics and 
science curriculum guides and text- 
books. It studied subject-matter content, 
sequencing of topics, and expectations 
for student performance. Teacher ques- 
tionnaires were not administered, as 



some of the graduating students who 
participated in the study were no longer 
enrolled in mathematics and science. 

TIMSS is the most fair and accurate 
international comparison of students 
that has ever been undertaken. In each 
nation, the students who participated in 
TIMSS were to be randomly selected to 
represent all students meeting the grade 
level or age criteria for each of the three 
populations. An international curricu- 
lum analysis was carried out prior to the 
development of the assessments to 
ensure that the items would reflect the 
mathematics and science curricula in 
the TIMSS countries. To further ensure 
that the assessments measured knowl- 
edge that the world community consid- 
ers important for students to know, the 
items were developed by international 
committees. International monitors 
carefully checked the translations and 
visited many classrooms while the assess- 
ments were being administered in each 
of the participating countries to make 
sure that the instructions were properly 
followed. 

The quality standards for the sampling 
process in TIMSS were higher than in 
any previous international comparison 
of education systems. Maintaining these 
high standards provided challenges for 
most of the countries that participated 
in this portion of TIMSS. Most of the 
23 countries — including the United 
States — experienced difficulties of vari- 
ous types. This is consistent with experi- 
ence in the United States in conducting 
assessments at the end of high school. 
Areas of difficulty included minimizing 
the extent to which students were 
excluded from the population eligible 
for the sample and gaining participation 
of schools and students after they were 
selected for the sample. 



While most countries had difficulties 
meeting the sampling standards in this 
portion of TIMSS, the nature of these 
difficulties, and the students and schools 
excluded, are generally well under- 
stood. Appendix 1 contains a summary 
of the TIMSS study guidelines and pro- 
vides information about sampling and 
adherence to sampling and other stan- 
dards in all the countries. All countries 
in which difficulties arose are shown in 
parentheses in the figures and tables in 
this report. The United States is in 
parentheses because its combined 
school and student participation rate 
was 64 percent, below the standard of 75 
percent. It is most likely that as a group, 
schools and students who were selected 
for TIMSS but did not participate in the 
assessments in the United States would 
have had below average scores, thus low- 
ering the U.S. average. This was proba- 
bly the case as well in other countries 
having similar difficulties. 

Full documentation of the data collec- 
tion methodologies and statistical analy- 
ses used in all the participating coun- 
tries is available in technical and quality 
control reports published by the TIMSS 
International Study Center at Boston 
College. A list of additional TIMSS 
reports published to date is contained in 
Appendix 7. 

COMPARING THE UNITED STATES 
TO OTHER COUNTRIES 

Some have argued that comparisons of 
the performance of U.S. students with 
students in other countries are inappro- 
priate. One argument is that, in the 
United States, larger portions of a given 
age cohort are enrolled in the education 
system — particularly at the secondary 
level — than in other countries, resulting 
in a comparison between our general 



population and more select groups in 
other countries. Another argument is 
that in international comparisons, while 
the United States tests a sample repre- 
sentative of our general student popula- 
tion, some countries test only those stu- 
dents in elite, college preparatory 
schools or courses of study. Although 
these arguments may have been valid in 
previous studies, neither holds true in 
TIMSS. 

As is discussed in more detail in Chapter 
4, the most recent data indicate that in 
most countries participating in TIMSS, 
secondary school enrollment rates are 
similar to that of the United States. Not 
only do the TIMSS countries have most 
of their secondary school-age popula- 
tion enrolled in school, the strict quality 
controls discussed earlier ensured that 
the sample of students taking the math- 
ematics and science general knowledge 
assessments were representative of the 
entire population at the end of sec- 
ondary school. Thus, for example, in 
most countries with distinct education 
“streams,” such as academic and voca- 
tional, students in all programs were 
represented in the TIMSS sample. This 
represents an improvement over previ- 
ous studies of secondary school achieve- 
ment, in which some countries only 
assessed students in certain types of 
schools or programs. 

Of course, there are still many other dif- 
ferences beuveen the secondary school 
systems of the countries participating in 
TIMSS. However, since a major goal of 
this component of TIMSS was to assess 
how well people entering adulthood 
understand the mathematics and sci- 
ence needed to function effectively in 
society, comparing students at the end 
of secondaiy school is entirely appropri- 
ate. This is because the end of secondary 



school represents the culmination of 
each country’s attempts to prepare all 
young people for living in society. 
Rather than use differences between sys- 
tems to argue against comparisons, or, at 
the other extreme, ignore such differ- 
ences, their relationship to mathematics 
and science achievement should be 
explored. 

THE TIMSS RESEARCH TEAM 

TIMSS was conducted by the lEA, which 
is a Netherlands-based organization of 
ministries of education and research 
institutions from its member countries. 
The lEA delegated responsibility for 
overall coordination and management 
of the TIMSS study to Albert Beaton at 
the TIMSS International Study Center, 
located at Boston College. Each of the 
lEA member nations that made the deci- 
sion to participate in TIMSS paid for 
and carried out the data collection in its 
own country according to the interna- 
tional guidelines. The cost of the inter- 
national coordination was paid by the 
National Center for Education Statistics 
(NCES) of the U.S. Department of Edu- 
cation, the National Science Foundation 
(NSF), and the Canadian Government. 

The United States portion of TIMSS was 
also funded by NCES and NSF. William 
Schmidt of Michigan State University 
was the U.S. National Research Coordi- 
nator. Policy decisions on the study were 
made by the U.S. National Coordinating 
Committee. NCES monitored the inter- 
national and U.S. TIMSS projects. The 
U.S. data collection was carried out by 
Westat, a private survey research firm. 
Trevor Williams and Nancy Caldwell 
were Westat project co-directors. The 
many advisors to the study are listed in 
Appendix 6. 



The U.S. TIMSS team also included the 
approximately 10,000 twelfth-grade stu- 
dents who took the assessments, and 
their principals in 210 schools nation- 
wide. Their cooperation has made this 
report possible. 

WHAT QUESTIONS DOES THIS 
REPORT ANSWER? 

This report answers three basic ques- 
tions: 

■ How does the mathematics and sci- 
ence general knowledge of U.S. 
twelfth graders compare to that of 
students completing secondary 
school in other nations? 

B How do U.S. high school seniors with 
instruction in physics and advanced 
mathematics perform in these sub- 
jects in comparison to advanced sci- 
ence and mathematics students in 
other nations? 

B What factors might contribute to the 
performance of the United States rel- 
ative to other countries in mathemat- 
ics and science at the end of sec- 
ondary school? 

Chapter 2 answers the first question. 
This question is important because it 
measures what our students know at the 
end of secondary school compared to 
similar students in other nations. The 
findings in this chapter reveal how well 
our students have been prepared by 12 
years of formal schooling for their 
future as adults in a world that increas- 
ingly relies on mathematics, science, 
and technology. 

Chapter 3 answers the second question. 
Ad\^nced students had taken or were 
taking higher level mathematics and 



science courses in secondary school, 
such as calculus and physics. Many are 
likely to become our nation’s next gen- 
eration of professionals in fields related 
to mathematics and science. 

Chapter 4 answers the third question. It 
examines a variety of factors related to 



schooling and students’ lives to see if 
any of them provide insight into why 
U.S. students perform as they do relative 
to students in other countries at the end 
of secondary school. 
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CHAPTER 2: 
ACHIEVEMENT OF 
ALL STUDENTS 



KEY POINTS: 



U.S. twelfth graders scored below the 
international average and among the lowest 
of the 21 TIMSS nations in both mathemat- 
ics and science general knowledge in the 
final year of secondary school. 



U.S. students’ international standing was 
stronger at the eighth grade than at the 
twelfth grade in both mathematics and 
science. 



The United States was one of three 
countries that did not have a significant 
gender gap in mathematics general 
knowledge at the end of secondary 
schooling. While there was a gender gap 
in science general knowledge in the United 
States, as in all the other TIMSS countries 
except one, the U.S. gender gap was one 
of the smallest. 
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The U.S. international standing on the 
general knowledge component of TIMSS 
was stronger in science than in 
mathematics.This pattern is similar to the 
findings at fourth and eighth grades in 
27 TIMSS. 



MATHEMATICS AND SCIENCE 
GENERAL KNOWLEDGE 

How well do young people understand 
the basic mathematics and science 
needed to function effectively in soci- 
ety? To answer this question, TIMSS 
developed assessments of mathematics 
and science general knowledge. These 
assessments were designed to determine 
students’ general level of knowledge of 
fundamental scientific and mathemati- 
cal concepts at the time they complete 
secondary education. These assessments 
were given to a random sample of all 
students at the grade set by their nation 
or program of studies as the end of their 
secondary schooling, regardless of 
whether or not they were currently tak- 
ing mathematics or science at the time 
of the study. 

Because the assessments were designed 
to examine how well students had 
acquired the mathematical and scientif- 
ic skills and knowledge judged by an 
international committee of experts to 
be necessary for all citizens in their daily 
life, the questions asked of the students 
were not tied to school curriculum. 
Instead, they covered the students’ 
knowledge of mathematical and scien- 
tific concepts, reasoning, and practical 
or “real world” applications. The results 
provide a glimpse of how well-prepared 
to function in the adult world are the 
graduates of the education system in the 
various TIMSS nations. 

This report examines the performance 
of U.S. students relative to students in 
other participating countries. Tempting 
though it may be, reporting U.S. scores 
by rank alone would be incorrect. This is 



because the average scores reported for 
each country were based on a sample of 
students in each country, and are there- 
fore estimates of the “true” scores that 
would have been achieved had all the 
eligible students participated in the 
assessments. 

While many steps were taken to ensure 
that the samples were representative of 
the total population, each estimated 
score has a margin of error associated 
with it. The margin of error is expressed 
as a “plus or minus” interval around the 
estimated score, creating a range of 
scores within which the true score is 
likely to fall. Thus, while one score may 
be higher than another, if the differ- 
ence between the two is small enough, it 
may fall within the margin of error and 
not be statistically significant. Because 
precise scores cannot be determined 
with perfect accuracy, to fairly compare 
the United States to other countries, 
nations have been grouped into 
broad bands according to whether 
their performance was significandy 
higher than, not significandy differ- 
ent from, or significandy lower than 
the United States. 

In TIMSS, we can say with 95 percent 
confidence that comparisons of other 
countries’ scores on the general 
knowledge assessments to those of 
the United States are accurate plus or 
minus about 12 to 36 points, depend- 
ing on the size and design of the sam- 
ples in other countries. Comparisons 
of the United States to the interna- 
tional average are accurate plus or 
minus about 7 points. (Table A2.1 in 
Appendix 2 contains a list of national 
averages and standard errors.) 







FIGURE 1: 

Mathematics General Knowledge Achievement 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY HIGHER THAN THE U.S. 


nation 


AVERAGE 


(NETHERLANDS) 


560 


SWEDEN 


552 


(DENMARK) 


547 


SWITZERLAND 


540 


(ICELAND) 


534 


(NORWAY) 


528 


(FRANCE) 


523 


NEW ZEALAND 


522 


(AUSTRALIA) 


522 


(CANADA) 


519 


(AUSTRIA) 


518 


(SLOVENIA) 


512 


(GERMANY) 


495 


HUNGARY 


483 



NATIONS WITH AVERAGE SCORES NOT 
SIGNIFICANTLY DIFFERENT FROM THE U.S. 



NATION 


AVERAGE 


(ITALY) 


476 


(RUSSIAN FEDERATION) 


471 


(LITHUANIA) 


469 


CZECH REPUBLIC 


466 


(UNITED STATES) 


461 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 


NATION 


AVERAGE 


(CYPRUS) 


446 


(SOUTH AFRICA) 


356 



INTERNATIONAL AVERAGE = 500 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I 
for details for each country. 

SOURCE: Mullls et al. ( 1 998). Mathemaucs and Science Achiewment in the Final Year of Secondary School. 

Table 2. 1 . Chestnut Hill, MA: Boston College. 



MATHEMATICS GENERAL 
KNOWLEDGE ASSESSMENT 

The mathematics general knowledge 
assessment consists of about 80 percent 
multiple choice items and 20 percent 
free-response items. Items were chosen 
based on their likelihood of arising in 
real-life situations and not on their 
connection to a particular curriculum. 
However, they can be described in 
terms of common mathematics curricu- 
lum topics, such as number sense, 
including fractions, percentages, and 
proportionality; algebraic sense; 
measurement and estimadon; and data 



representation. On average, for the 
countries pardcipating in the TIMSS 
assessment of mathematics general 
knowledge, these topics are typically 
covered in about the seventh grade. 

How Well Do U.S. Twelfth Graders 
Do On The Mathematics General 
Knowledge Assessment? 

On the mathematics portion of the 
general knowledge assessment, U.S. 
students scored below the international 
average, and among the lowest of the 21 
countries. Figure 1 shows how U.S. 
students performed on the mathemat- 
ics general knowledge assessment. 






In mathematics general knowledge, 
students in the final year of secondary 
school in 14 countries scored above 
our twelfth graders (the Netherlands, 
Sweden, Denmark, Switzerland, Iceland, 
Norway, France, New Zealand, Australia, 
Canada, Austria, Slovenia, Germany, 
and Hungary). Students in 4 countries 
were not significantly different from 
ours (Italy, the Russian Federation, 
Lithuania, and the Czech Republic). 
Students in two countries (Cyprus and 
South Africa) performed significantly 
below students in the United States. 

One explanation for our low perfor- 
mance that has been suggested in the 
past is that, because of our diverse pop- 
ulation, there is a greater range of 
scores among U.S. students, and the 
difference between our lowest-scoring 
students and our typical student is 
greater than in many other countries. 
These low-scoring students, it has been 
argued, “bring down” the U.S. average. 
Available information suggests that this 
is not the case in TIMSS."^ 

Looking at the distribution of scores can 
also illustrate the relatively low position 
of the United States in TIMSS. The 
entire distribution of U.S. scores is shift- 
ed downward from that of many of the 
high performing countries. For exam- 
ple, while a quarter of U.S. students 
scored 521 or higher, in many high-per- 
forming countries half or more of the 
students had scores that high. Further- 
more, the scores of U.S. students at the 
95th percentile were similar to those of 
students at the 75th percentile in some 
countries. (See Table A2.3 in Appendix 



2 for percentiles for mathematics gener- 
al knowledge; see Tables A2.4, A2.5, and 
A2.6 for percentiles for the other 
assessments.) 

What Were Students Asked To Do 
On The Mathematics General 
Knowledge Assessment? 

Mathematics general knowledge assess- 
ment items were designed to measure 
general knowledge and skills judged by an 
international committee of experts to be 
necessary for citizens in their daily life. 
Three examples of mathematics general 
knowledge assessment items are shown. 
Table A3.1 in Appendix 3 shows the per- 
centage of students responding correctly 
to each example item in every country. 

The item shown in Figure 2 requires stu- 
dents to use complex procedures to 
solve a percentage problem. Fifty-seven 
percent of U.S. twelfth graders respond- 
ed correctly to this item. The interna- 
tional average was 64 percent correct. 
Some students who responded incor- 
rectly chose “C,” which is simply the dif- 
ference of the two percentages, rather 
than correctly taking the product of the 
percentages. 

The item shown in Figure 3 requires stu- 
dents to provide their response in an 
open-ended format. Eighty-five percent 
of U.S. students responded correctly on 
this item. The international average was 
74 percent. Students needed to be able 
to read the line graph and use the 
labeled information on the vertical axis 
to provide the correct answer of 60 
km/h as the car’s maximum speed. 



^ Specifically, the difference between students with a median score (fiftieth percentile) and those at 
the fifth percentile is 129 points in the United States; looking at all countries, the average 
difference between fifth and fiftieth percentiles is 137 points. In addition, the difference between 
the scores of students at the fifth and ninety-fifth percentiles is similar in most countries. In the 
United States, 296 points separate these two groups of students, and the average difference is 292 
for all 21 countries. 
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FIGURE 2: 

Example 1; mathematics General Knowledge Item 



Experts say that 25% of all serious bicycle accidents Involve head Injuries and that 
of all head Injuries, 80% are fatal. 

What percent of all serious bicycle accidents involve fatal head Injuries? 



A. 


16% 


B. 


20% 


C. 


55% 


D. 


105% 



Correct Answer: 6 U.S. Average: 57 percent International Average: 64 percent 



SOURCE: Third International Mathematics and Science Study, 1994-1995. 



FIGURE 3: 

Example 2: Mathematics General Knowledge Item 



Kelly went for a drive In her car. During the drive, a cat ran in front of the car. 

Kelly slammed on the brakes and missed the cat. 

Slightly shaken, Kelly decided to return home by a shorter route. The graph 
below is a record of the car's speed during the drive. 

72 
60 
48 

Speed 36 
(km/h) 

24 
12 
0 

9:00 9:03 9:06 9:09 9:12 

Time 

What was the maximum speed, in kilometers per hour, of the car during the drive? 
Correct Answer: 60 km/h U.S. Average: 85 percent International Average: 74 percent 



SOURCE: Third International Mathematics and Science Study, 1994-1995. 
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FIGURE 4: 

Example 3: Mathematics General Knowledge Item 




The item in Figure 4 requires students 
to use the dimensions of a figure to solve 
a problem. Thirty-two percent of U.S. 
twelfth graders answered this item 
correctly. The international average was 
45 percent. Some students who respond- 
ed incorrectly forgot to take into 
account in their calculations the sides of 
the box that are not visible in the dia- 
gram or the 25 centimeters of 
ribbon needed to tie a bow. 



How Does U.S. Twelfth-Grade 
Students^ Relative Performance In 
Mathematics Compare To That Of 
U.S. Eighth-Grade Students? 

The group of countries participating in 
each phase of TIMSS differed. However, 
20 of the 21 countries participating in 
the general knowledge assessments in 
the final year of secondary schooling 
also participated in the middle school 
portion of TIMSS. V.^e can calculate an 
international average for mathematics 
achievement of students in these 20 
countries both for eighth grade and for 



the final year of secondary schooling. 
(This international average will differ 
from that based on all countries partici- 
pating in TIMSS at each grade level — 41 
in eighth grade and 21 for the final year 
of secondary schooling. The average 
U.S. eighth grade mathematics perfor- 
mance is below the international aver- 
age when the international average is 
based on all 41 countries participating 
in TIMSS at eighth grade, but is similar 
to the international average based on 
those 20 countries that also participated 
in the general knowledge assessments at 
the end of secondary schooling.) Table 
A5.1 in Appendix 5 shows the standing 
of each country relative to the 
20-country international average for the 
two grade levels and whether that rela- 
tive standing was different at the two 
grade levels. (See Table A5.2 in Appen- 
dix 5 for a similar comparison for the 12 
countries that participated in TIMSS 
both at fourth grade and in the general 
mathematics knowledge assessment at 
the end of secondary school.) 

The relative standing of U.S. students in 
mathematics was lower at twelfth grade 
than at eighth grade. About half the 
countries had a similar standing relative 
to the international average at both 
grade levels. The other half were about 
equally divided between those with a 
higher and a lower relative standing in 
the final year of secondary schooling 
than in eighth grade. The former group 
was composed of Nordic countries plus 
New Zealand, while the latter included 
countries from the former Communist 
Bloc and Australia, in addition to the 
United States. 



Is There A Gender Gap In 
Mathematics General Knowledge 
At The Twelfth Grade? 

In the United States and other coun- 
tries, policy makers have made great 
efforts to make mathematics and science 
more accessible to females, and to 
encourage gender equity in these sub- 
jects. Despite these efforts, students in 
the final year of secondary school in 
most TIMSS nations demonstrated a 
significant gender gap in the mathemat- 
ics portion of the general knowledge 
assessment, with males performing 
better than females. In the United States, 
boys’ and girls’ scores in mathematics 
general knowledge were not significandy 
different. The United States was one of 
three countries (in addition to South 
Africa and Hungary) among the TIMSS 
nations which did not have a significant 
gender gap in mathematics performance 
(see Table A5.3 in Appendix 5). 

Has The Relative International 
Standing Of The United States In 
Mathematics At The End Of 
Secondary School Changed Over 
Time? 

International comparisons over time are 
difficult. The first international studies 
of mathematics and science achieve- 
ment were conducted in the 1960s, and 
there have been other assessments in 
each subject since then. However, each 
assessment has been done differendy. A 
different set of nations participated, dif- 
ferent topics in mathematics and sci- 
ence were included in the assessments, 
the age and type of students sampled in 
each country changed slightly, and 
indeed even the borders and names of 
some of the nations have changed. Fur- 
thermore, the field of assessment has 




33 




matured greatly over the past 30 years, 
having made many improvements upon 
the methods of the then-revolutionary 
early studies. These and other factors 
complicate comparisons over time and 
require that any conclusions be neces- 
sarily tentative. 

In TIMSS, we have seen that U.S. twelfth 
graders scored below the international 
average in mathematics general knowl- 
edge, and among the lowest of all 
nations. This international standing was 
similar to the one reported for U.S. 
twelfth graders in the lEA First and Sec- 
ond International Mathematics Studies 
conducted in the 1960s and 1980s. 
Thus, relative to their international 
counterparts completing secondary 
school, it is unlikely that U.S. twelfth 
graders’ standing has changed signifi- 
cantly in mathematics achievement over 
the past 30 years. 

SCIENCE GENERAL KNOWLEDGE 
ASSESSMENT 

The science portion of the general 
knowledge assessment consisted of 
about 60 percent multiple choice items 
and 40 percent free-response items. 
Items were chosen based on their 
likelihood of arising in real-life situa- 
tions and not on their connection to a 
particular curriculum. Looked at in 
terms of common science curriculum 
topics, however, the items covered the 
topics of earth science, life science, and 
physical science. On average, for the 
countries participating in the TIMSS 
assessment of science general knowl- 
edge, these topics are typically covered 
in about the ninth grade. 



How Well Do U.S. Twelfth Graders 
Do On The Science General 
Knowledge Assessment? 

On the science portion of the general 
knowledge assessment, U.S. students 
scored below the international average, 
and among the lowest scoring of the 21 
countries. Figure 5 shows how U.S. stu- 
dents performed on the science general 
knowledge assessment. 

On the assessment of science general 
knowledge, students at the end of sec- 
ondary school in 11 countries (Sweden, 
the Netherlands, Iceland, Norway, 
Canada, New Zealand, Australia, 
Switzerland, Austria, Slovenia, and 
Denmark) outperformed U.S. twelfth 
graders. Students in 7 countries per- 
formed not significandy different from 
those in the United States (Germany, 
France, the Czech Republic, the Russian 
Federation, Italy, Hungary, and 
Lithuania). Students in Cyprus and 
South Africa performed below students 
in the United States. 

What Were Students Asked To Do 
On The Science General Knowledge 
Assessment? 

Three examples of TIMSS science gen- 
eral knowledge assessment items are 
presented. Table A3.1 in Appendix 3 
shows the percentage of students in 
every participating country responding 
correctly to each of these example 
items. 

The item shown in Figure 6 requires stu- 
dents to apply scientific principles to 
develop explanations. Forty-two percent 
of U.S. students responded correcdy to 
this item. The international average was 
61 percent correct. Some students' 



FIGURE 5: 

Science General Knowledge Achievement 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY HIGHER THAN THE U.S. 


NATION 


AVERAGE 


SWEDEN 


559 


(NETHERLANDS) 


558 


(ICELAND) 


549 


(NORWAY) 


544 


(CANADA) 


532 


NEW ZEALAND 


529 


(AUSTRALIA) 


527 


SWITZERLAND 


523 


(AUSTRIA) 


520 


(SLOVENIA) 


517 


(DENMARK) 


509 



INTERNATIONAL AVERAGE = 500 



NATIONS WITH AVERAGE SCORES NOT 
SIGNIFICANTLY DIFFERENT FROM THE U.S. 


NATION 


AVERAGE 


(GERMANY) 


497 


(FRANCE) 


487 


CZECH REPUBLIC 


487 


(RUSSIAN FEDERATION) 


481 


(UNITED STATES) 


480 


(ITALY) 


475 


HUNGARY 


471 


(LITHUANIA) 


461 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 


NATION 


AVERAGE 


(CYPRUS) 


448 


(SOUTH AFRICA) 


349 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. 

See Appendix I for details for each country. 

SOURCE: Mullis et al. (1998). /Vlothemotics and Science Achievement in the Final Year afSecandary Schaal. 
Table 2.2. Chestnut Hill, MA: ^ston College. 



FIGURE 6: 

Example 4: Science General Knowledge Item 



Some high-heeled shoes are claimed to damage floors. The base diameter of 
these very high heeis is about 0.5 cm and of ordinary heeis about 3 cm. Briefly 
explain why the very high heeis may cause damage to floors. 

Correct Answer Examples: 

• “The pressure from the heel Is greater because the area Is smaller.” 

• "Because of the narrow diameter of very high heels, all the body weight is 
spread over a smaller area. There Is greater pressure exerted On the floor 
with the higher heels because it Is all placed on a small area. The pressure Is 
less on a wider heel because the weight Is distributed over a greater area 
causing less damage." 

U.S. Average: 42 percent International Average: 61 percent 



SOURCE: Third International Mathematics and Science Study, 1994-1995. 
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FIGURE 7: 

Example 5: Science General Knowledge Item 



CFCs (chlorofluorocarbons) revolutionized personal and industrial life for 30 years. 
They were the coolant in refrigerators and the propellants in aerosols, pressure 
packs, and fire extinguishers. There are now very strong international moves to stop 
the use of these substances because: 

A they are chemically inert. 

B. they contribute to the greenhouse effect. 

C. they are poisonous to humans. 

D. they destroy the ozone layer. 



Correa Answer: D US. Average: 78 percent International Average: 77 percent 



SOURCE: Third International Mathematics and Science Study, 1994-1995. 



incorrect responses, such as “because 
they are sharper and poke into the 
floor,” attributed the damage to sharp- 
ness rather than the effects of pressure 
placed on a small surface area. 

The item shown in Figure 7 requires an 
understanding of causes of pollution. 
Seventy-eight percent of U.S. twelfth 
graders responded correctly on this 
item. The international average was 77 
percent. 

The item shown in Figure 8 requires 
knowledge of complex information 
about the interdependence of life. The 
U.S. average was 40 percent correct, and 
the international average was 37 
percent. Some students who responded 
incorrectly to this item were not suffi- 
ciently explicit about how a species can 
regulate the population of its prey. 



How Does U.S. Twelfth-Grade 
Students' Relative Performance In 
Science Compare To That Of U.S. 
Eighth-Grade Students? 

As in mathematics, it is possible to com- 
pare the science performance of all U.S. 
students at both eighth grade and in the 
final year of secondary school to the 
group of 20 countries that participated 
in both of these portions of TIMSS. 
Table A5.4 in Appendix 5 displays the 
standing for each country relative to the 
international average for science 
achievement for the two grade levels 
based on the 20 countries and whether 
that relative standing was different at 
the two grade levels (See Table A5.5 in 
Appendix 5 for a similar comparison for 
the 12 countries that participated in 
TIMSS both at fourth grade and in the 
science general knowledge assessment 
at the end of secondaiy school.) 



FIGURE 8: 

Example 6; Science General Knowledge Item 



When an animal or plant species is introduced to an area where it has never 
previously existed, it frequently creates a problem by multiplying out of control 
and displacing established species. One way of fighting introduced species is 
to poison them. This may be impractical, be very costly or carry heavy risks. 
Another method, called biologico! control involves the use of living organisms, 
other than human beings, to control the pest species. 

Give an actual example of a biological control. 



Correct Answer Examples: 

• “Hove o house cat in your house to rid mice as a biological control" 

• '^Ladybugs are introduced to eat aphids." 



US. /Average: 40 percent /nternot/ono/ /Average: 37 percent 



SOURCE: Third International Mathematics and Science Study, 1994-1995. 



In science, the United States is one of 7 
countries where the standing relative to 
the international average was lower at 
the end of secondary schooling than it 
was at eighth grade. The others were for- 
mer Communist Bloc countries plus 
Australia and Germany. Eight countries 
had a similar standing relative to the 
international average at both grade lev- 
els and 5 had a higher relative standing 
in the final year of secondary schooling 
than in eighth grade. 



Is There A Gender Gap In Science 
General Knowledge At The Twelfth 
Grade? 

In the United States, there was a gender 
gap on the science portion of the 
twelfth-grade general knowledge assess- 
ment. Excluding South Africa, in all 
other TIMSS nations, including the 
United States, males performed signifi- 
cantly better than females in science. 
However, among those countries, the 
U.S. gender gap in science was one of 
the smallest (see Table A5.6 in 
Appendix 5). 




r r 





Has The Relative International 
Standing Of The United States In 
Science At The End Of Secondary 
School Changed Over Time? 

In TIMSS, we have seen that U.S. twelfth 
graders scored below the international 
average in science, and among the low- 
est of all nations. This is basically the 
same relative international standing 
reported for U.S. twelfth graders in the 
lEA First and Second International Sci- 
ence Studies in the 1960s and 1980s. 
Thus, relative to their international 
counterparts in the final year of sec- 
ondary school, it is unlikely that U.S. 
twelfth graders’ standing has changed 
significandy in science. 

How Does The Performance Of 
U.S. Twelfth Graders In Science 
Compare To Their Performance In 
Mathematics? 

Although U.S. students scored below 
the international average and among 
the lowest of TIMSS nations on both 
portions of the general knowledge 
assessments, the U.S. international 
standing on the general knowledge 
assessments was slighdy higher in 
science than it was in mathematics. 



Fourteen countries were significantly 
higher than the United States in the 
mathematics general knowledge assess- 
ment, while 11 countries outperformed 
the United States in science general 
knowledge. This pattern is similar to the 
fourth- and eighth-grade TIMSS results, 
in which the U.S. relative international 
standing was higher in science than it 
was in mathematics. 

Among the major trading partners of 
the United States that participated in 
TIMSS at the end of secondary school, 
students in Canada outperformed the 
U.S. in both mathematics and science 
general knowledge. Students in France 
and Germany outperformed U.S. stu- 
dents in m ath e ma ti cs gene ral kn owl- 
edge, and performed similar to U.S. stu- 
dents in science. 

We have now examined what TIMSS 
tells us about all students in their final 
year of secondary school. Next, we turn 
to an examination of how the advanced 
students in the United States who were 
taking or had taken advanced courses in 
mathematics and science compared to 
their counterparts in other TIMSS 
nations. 
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CHAPTER 3: 
ACHIEVEMENT OF 
ADVANCED STUDENTS 



KEY POINTS: 



The performance of U.S. physics and 
advanced mathematics students was among 
the lowest of the 1 6 countries that 
administered the physics and advanced 
mathematics assessments. 



In all five content areas of physics and 
in all three content areas of advanced 
mathematics, U.S. physics and advanced 
mathematics students’ performance was 
among the lowest of theTIMSS nations. 



In both physics and advanced mathematics, 
males outperformed females in the United 
States. This was true for 4 of the 5 
content areas in physics and for all 3 of the 
content areas in advanced mathematics. 
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More countries outperformed the United 
States in physics than in advanced 
mathematics. This differs from results for 
mathematics and science general 
knowledge, where more countries 
outperformed the United States in 
mathematics than in science. 



Chapter 2 has shown us how U.S. twelfth 
graders performed in mathematics and 
science general knowledge in compari- 
son to students at the close of their 
secondary school studies in other coun- 
tries. It shows us the level of general 
mathematics and scientific knowledge 
of the entire sampled student popula- 
tion. But because advances in science 
and technology are playing a greater 
role in shaping the future of our nation 
and our world, it is useful to look 
beyond the general levels of science and 
mathematics general knowledge and 
focus on the advanced levels of knowl- 
edge of those who are likely to become 
our next generation of professionals in 
fields related to mathematics and 
science. 

Therefore, in addition to the TIMSS 
assessments of science and mathematics 
general knowledge, other assessments 
were created to compare the achieve- 
ment of students taking advanced 
science and mathematics courses. 
Physics was selected by the participating 
countries for the advanced science 
assessment because “it is the branch of 
science most closely associated with 
mathematics,” and because it was viewed 
as coming “closest to the essential ele- 
ments of natural science.”” Students 
were allowed to use calculators on the 
assessments and relevant formulas were 
provided. 

The numbers of students participating 
in the physics and advanced 
mathematics assessments were generally 
much smaller (one-third to one-half as 
many) than in the mathematics and 
science general knowledge assessments. 
As a result, estimates of a country’s 
average scores in the physics and 



advanced mathematics assessments have 
larger margins of error than in the 
mathematics and science general knowl- 
edge assessments. We can say with 95 
percent confidence that comparisons of 
other countries’ scores to those of the 
United States are accurate plus or minus 
20 to 40 points on advanced mathemat- 
ics, and 15 to 65 points on physics, 
depending on the size and design of the 
samples in other countries. Compar- 
isons of the United States with the inter- 
national average are accurate plus or 
minus about 12 points for advanced 
mathematics and 7 points for physics. 
(Table A2.2 in Appendix 2 contains a list 
of national average scores and standard 
errors.) 

ADVANCED MATHEMATICS 
ASSESSMENT 

An assessment of advanced mathematics 
was given to a sample of students taking 
advanced coursework in mathematics. 
In the United States, these were students 
who had taken or were taking a full year 
of a high school course that included the 
word “calculus” in the title. This includ- 
ed calculus, pre-calculus, Advanced 
Placement calculus, and calculus and 
analytic geometry. It should be noted, 
however, that the advanced mathematics 
assessment was not primarily a calculus 
assessment. About one-quarter of the 
items were in the content area of calcu- 
lus. Other content areas included in the 
assessment were: numbers, equations, 
and functions; validation and structure; 
probability and statistics; and geometry. 
Sub-scales were created for the geome- 
try; calculus; and numbers, equations, 
and functions content areas. The 
number of items in the other two 
categories was too small to obtain 
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reliable scores so separate sub-scales 
were not developed for them. On the 
advanced mathematics assessment, 
three-quarters of the items were multiple 
choice and one-quarter free response. 

Fewer countries participated in the 
advanced mathematics assessment than 
in the general knowledge assessments. 
Among the 21 countries which partici- 
pated in the mathematics and science 
general knowledge assessments, six 
countries (Hungary, Iceland, the 
Netherlands, New Zealand, Norway, and 
South Africa) did not administer the 
advanced mathematics assessment. 
Greece, which did not participate in the 
mathematics and science general knowl- 
edge assessments, participated in the 
advanced mathematics assessment. As a 
result, 16 countries participated in the 
advanced mathematics assessment. 

The goal of the advanced mathematics 
assessment was to compare the mathe- 
matics performance of students in the 
most advanced 10 to 20 percent of their 
age cohort across nations. Countries 
were asked to identify these students 
using definitions appropriate for their 
own education systems. In the United 
States, in order to meet the criterion of 
representing 10 to 20 percent of the age 
cohort, students whose highest mathe- 
matics course was pre-calculus were 
included along with students who had 
studied or were studying calculus. 

In two countries, the Russian Federation 
and Lithuania, the advanced mathemat- 
ics students constituted less than 5 per- 
cent of their age cohort; in Austria, Ger- 
many, and Slovenia, they constituted 



more than 20 percent. In the remaining 
11 countries — including the United 
States — students in the advanced mathe- 
matics assessment were representative of 
about 10 to 20 percent of their age 
cohort. Table A5.7 in Appendix 5 con- 
tains the estimated percentages of the 
age cohort in each country represented 
by students who took the advanced 
mathematics assessment. 

How Do Our Twelfth Graders With 
Advanced Mathematics Instruction 
Compare To Advanced Mathematics 
Students In Other Countries? 

The performance of U.S. twelfth-grade 
advanced mathematics students was 
among the lowest of the 16 TIMSS 
nations who administered the assess- 
ment to a comparable population of 
their advanced mathematics students 
and below the international average. 
Figure 9 shows that 11 nations outper- 
formed the United States, while U.S. 
scores were not significantly different 
from those of 4 other nations. No 
countries scored below the United 
States on the assessment of advanced 
mathematics. 

U.S. advanced mathematics students 
included those who had completed or 
were completing pre-calculus, calculus, 
calculus and analytic geometry, or 
Advanced Placement calculus, repre- 
senting about 14 percent of the school- 
completing age cohort in the United 
States. If we compared only those U.S. 
students who had taken or were taking 
calculus or Advanced Placement calculus 
against all the advanced mathematics 
students in other countries, how did our 
calculus students perform? 
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FIGURE 9: 

Average Advanced Mathematics Performance of Advanced Mathematics Students 

IN Ail Countries 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY HIGHER THAN THE U.S. 



NATION 


AVERAGE 


FRANCE 


557 


(RUSSIAN FEDERATION) 


542 


SWITZERLAND 


533 


(AUSTRALIA) 


525 


(DENMARK) 


522 


(CYPRUS) 


518 


(LITHUANIA) 


516 


GREECE 


513 


SWEDEN 


512 


CANADA 


509 


(SLOVENIA) 


475 



NATIONS WITH AVERAGE SCORES NOT 
SIGNIFICANTLY DIFFERENT FROM THE U.S. 



NATION 


AVERAGE 


(ITALY) 


474 


CZECH REPUBLIC 


469 


(GERMANY) 


465 


(UNITED STATES) 


442 


(AUSTRIA) 


436 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 



NATION AVERAGE 



NONE 



INTERNATIONAL AVERAGE = 501 



NOTE: Nations not meeting international sampling or other guidelines are shown in parentheses. 
See Appendix I for details for each country. 



SOURCE: Mullis et al. (1998). Mot/iemot/cs and Science Achievement in the Final Year afSecandary Schaal. 
Table 5. 1 . Chestnut Hill. MA: Boston College. 



How Do U.S. Twelfth Graders With 
Calculus Or Advanced Placement 
Calculus Compare To All Advanced 
Mathematics Students In Other 
Countries? 

U.S. twelfth graders with calculus or 
Advanced Placement calculus instruction 
represented about 7 percent of the U.S. 
age cohort. These students did perform 
better in the assessment than the larger 
U.S. group that also included students 
whose highest course was pre-calculus. 



Advanced mathematics students in 6 
countries (France, the Russian 
Federation, Switzerland, Denmark, 
Cyprus, and Lithuania) outperformed 
calculus and AP calculus students in the 
U.S. Figure 10 shows that the 
performance of U.S. twelfth graders 
vdth calculus or Advanced Placement 
calculus instruction was not significantly 
different from the international average 
and 7 of the 16 TIMSS nations that 
administered the assessment to their 
advanced mathematics students. Our 
scores were significantly higher than 
those of two other nations (Germany 
and Austria). 






FIGURE 10: 

Average Advanced Mathematics Performance of Advanced Mathematics Students in 
Other Countries Compared with U.S. Calculus and AP Calculus Students 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY HIGHER THAN THE U.S. 



NATION 


AVERAGE 


FRANCE 


557 


(RUSSIAN FEDERATION) 


542 


SWITZERLAND 


533 


(DENMARK) 


522 


(CYPRUS) 


518 


(LITHUANIA) 


516 



INTERNATIONAL AVERAGE = 504 



*The placement of Australia may appear out of place; 



NATIONS WITH AVERAGE SCORES NOT 
SIGNIFICANTLY DIFFERENT FROM THE U.S. 



NATION 


AVERAGE 


(AUSTRAUA)* 


525 


GREECE 


513 


SWEDEN 


512 


CANADA 


509 


(UNITED STATES) 


492 


(SLOVENIA) 


475 


(ITALY) 


474 


CZECH REPUBLIC 


469 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 


NATION 


AVERAGE 


(GERMANY) 


465 


(AUSTRIA) 


436 



r, statistically its placement is correct 



NOTE: Nations not meeting international sampling or other guidelines are shown in parentheses. 
See Appendix I for details for each country. 



SOURCES: Mullis et al. ( 1 998). Mathematics and Science Achievement in the Final Year of Secondary School. 
Table 5.1. Chestnut Hill, MA: Boston College; and unpublished tabulations. 



The performance of U.S. twelfth 
graders with Advanced Placement 
calculus instruction, who represent 
about 5 percent of the U.S. age cohort 
was significandy higher than the perfor- 
mance of advanced mathematics stu- 
dents in 5 other countries. Figure 11 
shows that one nation (France) outper- 
formed the United States, while our 
scores were not significantly different 
from 9 other countries and the interna- 
tional average. Thus, the most advanced 
mathematics students in the United 
States, about 5 percent of the total age 
cohort, performed similarly to 10 to 20 
percent of the age cohort in most of the 
other countries. 



How Do U.S. Students Score In 
The Different Content Areas Of 
Advanced Mathematics? 

Representing student achievement in 
advanced mathematics as a total score is a 
useful way to summarize achievement. 
However, the advanced mathematics 
assessment contained different content 
areas, which are emphasized and se- 
quenced differently in curricula around 
the world. Based on national priorities, 
some content areas have been studied 
more than others in different countries 
by the time these students are ready to 
graduate from secondary school. 
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FIGURE 11: 

Average Advanced Mathematics Performance of Advanced Mathematics Students In 
Other Countries Compared With U.S. AP Calculus Sfjdents 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY HIGHER THAN THE U.S. 



NATION 


AVERAGE 


FRANCE 


557 



NATIONS WITH AVERAGE SCORES NOT 
SIGNIFICANTLY DIFFERENT FROM THE U.S. 


NATION 


AVERAGE 


(RUSSIAN FEDERATION) 


542 


SWITZERLAND 


533 


(AUSTRALIA) 


525 


(DENMARK) 


522 


(CYPRUS) 


518 


(LITHUANIA) 


516 


(UNITED STATES) 


513 


GREECE 


513 


SWEDEN 


512 


CANADA 


509 



NOTE: Nations not meeting international sampling and 
See Appendix I for details for each country. 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 



NATION 


AVERAGE 


(SLOVENIA) 


475 


(ITALY) 


474 


CZECH REPUBLIC 


469 


(GERMANY) 


465 


(AUSTRIA) 


436 



INTERNATIONAL AVERAGE = 505 



other guidelines are shown in parentheses. 



SOURCES: Mullis et al. ( 1 998). Mathemat/cs and Science Achievement in the Final Year ofSeconda/y School. 
Table 5.1. Chestnut Hill, MA; Boston College; and unpublished tabulations. 



The TIMSS advanced mathematics 
assessment included sets of items 
designed to sample students’ ability to do 
work in the following areas: 

Numbers, Equations, and Functions: 
Complex numbers and their proper- 
ties; permutations and combinations; 
equations and formulas; and 
patterns, relations, and functions. 

Calculus: 

Infinite processes; and change. 



Geometry: 

Basic geometry; coordinate geome- 
try; polygons and circles; and three- 
dimensional geometry. 

Figure 12 shows that in all of the content 
areas of advanced mathematics, U.S. stu- 
dents’ performance was among the low- 
est of the TIMSS nations. 

Among the content areas, U.S. students’ 
performance was relatively weakest in 



FIGURE 12: 

Achievement in Advanced Mathematics Content Areas 



NUMBERS & EQUATIONS 



CALCULUS 



GEOMETRY 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
HIGHER THAN THE U.S. 


NATION 


AVERAGE 


(RUSSIAN FEDERATION) 


555 


FRANCE 




548 


(LITHUANIA) 




547 


GREECE 




539 


SWEDEN 




523 


(AUSTRALIA) 




517 


SWITZERLAND 




514 


(CANADA) 




512 


(CYPRUS) 




510 


(DENMARK) 




504 


(SLOVENIA) 




491 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
HIGHER THAN THE U.S. 


NATION 


AVERAGE 


(CYPRUS) 


561 


FRANCE 


560 


GREECE 


538 


(RUSSIAN FEDERATION) 537 


(AUSTRALIA) 


530 


(ITALY) 


520 


SWITZERLAND 


512 


(DENMARK) 


508 


(CANADA) 


503 


(LITHUANIA) 


498 


SWEDEN 


480 



NATIONS WITH AVERAGE 
SCORES NOT SIGNIFICANTLY 
DIFFERENT FROM THE U.S. 


NATIONS WITH AVERAGE 
SCORES NOT SIGNIFICANTLY 
DIFFERENT FROM THE U.S. 


NATION AVERAGE 


NATION AVERAGE 


CZECH REPUBLIC 460 

(ITALY) 460 

(UNITED STATES) 459 

(GERMANY) 457 


(SLOVENIA) 471 

(GERMANY) 454 

(UNITED STATES) 450 

CZECH REPUBLIC 446 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
HIGHER THAN THE U.S. 


NATION AVERAGE 


(RUSSIAN FEDERATION) 


548 


SWITZERLAND 


547 


FRANCE 


544 


(DENMARK) 


527 


(CYPRUS) 


517 


(LITHUANIA) 


515 


(CANADA) 


499 


GREECE 


498 


(AUSTRALIA) 


496 


CZECH REPUBLIC 


494 


SWEDEN 


492 


(GERMANY) 


487 


(ITALY) 


480 


(SLOVENIA) 


476 


(AUSTRIA) 


462 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
LOWER THAN THE U.S. 




NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
LOWER THAN THE U.S. 


NATION AVERAGE 


NATION AVERAGE 


(AUSTRIA) 412 




(AUSTRIA) 439 



NATIONS WITH AVERAGE 
SCORES NOT SIGNIFICANTLY 
DIFFERENT FROM THE U S. 



NATION 



AVERAGE 



(UNITED STATES) 



424 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
LOWER THAN THE U.S. 



NATION 



AVERAGE 



NONE 



INTERNATIONAL AVERAGE = 501 INTERNATIONAL AVERAGE = 501 INTERNATIONAL AVERAGE = 500 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. 

See Appendix 1 for details for each country. 

SOURCE: Mullis et al. (1998). Mathematics and Science Achievement in the Final Year of Secondary School. 
Table 6. 1. Chestnut Hill, MA: Boston College. 





FIGURE 13: 

Example 7: Geometry Item 



In the AABC, shown below, the altitudes BN and CM intersect at point S. The measure * 
of the XMSB is 40’ and the measure of XSBC is 20’. Write a PROOF of the following 
statement: 

"AABC is isosceles." 

Give geometric reasons for statements in your proof. 



A 




Correct Ar^swer Example: 

Correct proof proves that iB = iC. using the following facts: 

• the sum of angles in any triangle is ISd" 

• if two angles of a triangle are equai the triangle is isosceles 
also may include: 

—vertically opposite angles are equal 
—supplementary angles add to /flO" 

U.S. Average: 19 percent International Average: 48 percent 



SOURCE: Third International Mathematics and Science Study, I994>I995. 



geometry: no country scored similar to 
or below the United States. In numbers, 
equations, and functions, as well as in 
calculus, fewer countries (11 countries) 
scored above the United States. See 
Table A4.1 in Appendix 4 for U.S. AP 
and non-AP calculus students’ scores by 
content area. 



What Were Students Asked To Do 
On The Advanced Mathematics 
Assessment? 

There are three examples of advanced 
mathematics assessment items. Table 
A3. 2 in Appendix 3 shows the percent- 
age of students in every country 
responding correctly to each of these 
example items. 



An example of a geometry item is shown 
in Figure 13. This item required 




FIGURE 14; 

Example 8: Probability And Statistics Item 



A set of 24 cards is numbered with the positive integers from 1 to 24. if the cards 
are shuffied and if oniy one is seiected at random, what is the probabiiity that 
the number on the card is divisible by four or six? 




Correct Answer: D US. Average: 62 percent International Average: 50 percent 



SOURCE: Third International Mathematics and Science Study, 1994-1995. 



students to prove and justify the given 
statement. The international average for 
this item was 48 percent. Nineteen per- 
cent of U.S. students responded at least 
partially correctly. Over one-third of 
U.S. students did not receive credit for 
this item due to incorrect argumenta- 
tion and/or including more than one 
incorrect geometric fact, step, or reason. 
Figure 14 is an example of a probability 
and statistics item. Of U.S. students, 62 
percent responded correctly. The 
international average was 50 percent 
correct. Some students who responded 



incorrectly to this item chose “E,” 
perhaps simply counting all of the even 
numbers between four and twenty-four, 
rather than correcdy counting only the 
factors of 24 that are divisible by four or 
six. 

The calculus item shown in Figure 15, 
that required students to demonstrate 
their understanding of integrals, proved 
to be a difficult item for most students, 
including U.S. students. Twenty-seven 
percent of U.S. students responded cor- 
rectly to this item, and the international 



FIGURE 15: 

Example 9: Calculus Item 



y 




The figure above shows the graph of y = /(x). 

S, is the area enclosed by the x-axis, x = a, and y = / (x); 

$2 is the area enclosed by the x-axis, x = b, and y = / (x); 
where a<b and 0<S2<S^. 

b 

The value of // (x) dx is 

a 

A S, + $2 

B S, - S 2 

C S 2 - S, 

D |S,-S2| 

E -(S. + Sj) 

2 

Correa Answer: C U.S. Average: 27 percent International Average: 35 percent 

SOURCE: Third International Mathematics and Science Study, 1994-1995. 
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average was about 35 percent. Many stu- 
dents who responded incorrectly appar- 
ently did not recognize that if a curve 
lies above the x-axis, the integral repre- 
sents the area under the curve, and if 
the curve lies below the x-axis, the inte- 
gral represents the negative of the area 
between the curve and the x-axis. 

Is There A Gender Gap In Advanced 
Mathematics At The Twelfth Grade? 

In the United States, twelfth-grade 
males outperformed twelfth-grade 
females in advanced mathematics. The 
United States was one of the 11 TIMSS 
nations in which a gender gap existed. 
No significant gender gap existed in the 
other 5 countries. For the United States 
and 7 other countries, there was a sig- 
nificant gender gap existing in all 
3 advanced mathematics content areas. 
(See Tables A5.8 and A5.9 in Appendix 5.) 

PHYSICS ASSESSMENT 

The TIMSS physics assessment included 
questions about mechanics; electricity 
and magnetism; particle, quantum and 
other types of modern physics; heat; 
and wave phenomena. In the United 
States, the population that took the 
assessment was twelfth graders 
who had taken or were taking at least 
one year-long course in physics. This 
included physics I, physics II, advanced 
physics, and Advanced Placement 
physics. 

Fewer countries participated in the 
physics assessment than in the general 
knowledge assessments. Among the 21 
countries which participated in the 
mathematics and science general knowl- 



edge assessments, 7 countries (Hungary, 
Iceland, Italy, Lithuania, the Nether- 
lands, New Zealand, and South Africa) 
did not administer the physics assess- 
ment. Greece and Latvia, which did not 
participate in the general knowledge 
assessments, participated in the physics 
assessment. As a result, 16 countries par- 
ticipated in the physics assessment. 

In general, countries identified similar 
percentages of an age cohort as appro- 
priate for the physics assessment. 
Although countries used their own 
definitions to identify advanced science 
students, for 11 of the 16 countries, 
including the United States, these 
students represented about 10 to 20 
percent of their age cohort. The only 
exceptions to this pattern were Den- 
mark, Latvia, and the Russian Federa- 
tion, where physics students represented 
less than 5 percent of the age cohort, 
and Austria and Slovenia, where the stu- 
dents represented more than 20 percent 
of the age cohort. (Table A5.7 in Appen- 
dix 5 contains the percentages of the 
age cohort in each country represented 
by students who took the physics assess- 
ment.) 

How Do U.S. Twelfth Graders With 
Physics Instruction Compare To 
Advanced Science Students In Other 
Countries? 

The performance of U.S. twelfth-grade 
physics students was among the lowest 
of the 16 TIMSS nations that adminis- 
tered the assessment to a comparable 
population of their students and below 
the international average. Figure 16 
shows that 14 nations outperformed the 
United States, while our scores were not 
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FIGURE 16: 

Average Physics Performance of Advanced Science Students in All Countries 



NATIONS WITH AVERAGE SCORES 

significantly higher than the U.S. 


NATION 


AVERAGE 


NORWAY 


581 


SWEDEN 


573 


(RUSSIAN FEDERATION) 


545 


(DENMARK) 


534 


(SLOVENIA) 


523 


(GERMANY) 


522 


(AUSTRALIA) 


518 


(CYPRUS) 


494 


(LATVIA) 


488 


SWITZERLAND 


488 


GREECE 


486 


(CANADA) 


485 


FRANCE 


466 


CZECH REPUBLIC 


451 



NOTE: Nations not meeting international sampling and 
See Appendix I for details for each country. 



nations with average scores not 
significantly different from the U.S. 


NATION 


AVERAGE 


(AUSTRIA) 


435 


(UNITED STATES) 


423 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 



NATION AVERAGE 



NONE 



INTERNATIONAL AVERAGE = 501 



other guidelines are shown in parentheses. 



SOURCE: Mullis et al, ( 1 998), Mothemat/cs and Science Achievement in the Final Year of Secondary School. 
Table 8. 1 . Chestnut Hill, MA: Boston College. 



significantly different from those of one 
other nation. No countries scored below 
the United States on the physics assess- 
ment. One interesting aspect of the 
scores on the physics assessment is that 
there was less variation in the scores 
among U,S, students than in 13 of the 
other 15 countries. The range of U,S. 
students scores was relatively narrow — 
189 points between the 5th and 95th per- 
centile compared to an average differ- 
ence of 293 points for all 16 countries. 



In the United States, the population 
that took the assessment were twelfth 
graders who had completed or were 
completing physics I, physics II, 
advanced physics, or Advanced Place- 
ment physics, representing about 14 
percent of the age cohort. If we 
compared only those U.S. students who 
had taken or were taking Advanced 
Placement physics with all the advanced 
science students in other countries, how 
did U.S. AP physics students perform? 



FIGURE 17: 

Average Physics Performance of Advanced Science Students in Other Countries 
Compared with U.S. AP Physics Students 



nations with average scores 
significantly higher than the U.S. 



NATION 


AVERAGE 


NORWAY 


581 


SWEDEN 


573 


(RUSSIAN FEDERATION) 


545 


(DENMARK) 


534 


(GERMANY) 


522 


(AUSTRALIA) 


518 



international average = 504 



nations with average scores not 

SIGNIFICANTLY DIFFERENT FROM THE U.S. 



NATION 


AVERAGE 


(SLOVENIA)* 


523 


(CYPRUS) 


494 


(LATVIA) 


488 


SWITZERLAND 


488 


GREECE 


486 


(CANADA) 


485 


(UNITED STATES) 


474 


FRANCE 


466 


CZECH REPUBLIC 


451 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 



NATION AVERAGE 

(AUSTRIA) 435 



*The placement of Slovenia may appear out of place: however, statistically its placement is correct. 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. 

See Appendix I for details for each country. 

SOURCE: Mullis et al. ( 1 998). Alothemat/cs and Sdence Achievement in the Final Year af Secandary Schaal. 
Table 8. 1 , Chestnut Hill, MA: Boston College. 



How Do U.S. Twelfth Graders With 
Advanced Placement Physics 
Instruction Compare To Advanced 
Science Students In Other 
Countries? 

U.S. twelfth graders with Advanced 
Placement physics represented about 1 
percent of the age cohort in the United 
States. U.S. students who had taken or 
were taking Advanced Placement 
physics were outperformed by advanced 
science students in fewer nations than 



were the students in our latter group of 
physics students. Figure 17 shows that 
U.S. Advanced Placement physics stu- 
dents scored below the international 
average and advanced science students 
in’ 6 nations, while the average U.S. 
score was significandy higher than that 
of one other nation. The performance 
of U.S. twelfth graders with Advanced 
Placement physics instrucdon was no 
different from the performance of 8 of 
the 16 TIMSS nations that administered 
the assessment to their advanced science 
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students. However, U.S. Advanced Place- 
ment physics students represented a 
much smaller proportion of the age 
cohort in the United States than did the 
advanced science students in most of 
the other countries. 

How Do U.S. Students Score In The 
Different Content Areas Of Physics? 

Representing student achievement in 
physics as a total score is a useful way to 
summarize achievement. However, the 
physics assessment contained different 
content areas, which are emphasized 
and sequenced differently in curricula 
around the world. Based on national 
priorities, and sequencing of physics 
instruction for advanced students at the 
secondary level, some content areas 
have been studied more than others in 
various countries by the time these stu- 
dents graduate from secondary school. 

The TIMSS physics assessment included 
sets of items designed to sample students’ 
ability to do work in the following areas: 

Mechanics: Dynamics of motion; time, 
space and motion; types of forces; 
and fluid behavior. 

Electricity/ magnetism: Electricity; and 
magnetism. 

Heat: Physical changes; energy types, 
sources and conversions; heat and 
temperature; and kinetic theory. 

Wave phenomena: Sound and vibration; 
light; and wave phenomena. 

Modern physics: Nuclear chemistry; 
quantum theory and fundamental 
particles; astrophysics; subatomic 
particles; and relativity theory. 



Figure 18 shows that in all five physics 
content areas, U.S. students’ performance 
was among the lowest of the TIMSS 
nations. In two content areas, one nation 
scored below the United States. Students 
in Austria scored below students in the 
United States in the content area of heat 
and students in Cyprus scored below U.S. 
students in the area of modem physics. 
Among the content areas, U.S. students 
performed the poorest in the content 
areas of mechanics and electricity/mag- 
netism, in terms of the number of 
countries outperforming the United 
States. See Table A4.2 in Appendix 4 for 
U.S. AP and non-AP physics students’ 
scores by content area. 

What Were Advanced Science 
Students Asked To Do On The 
Physics Assessment? 

On pages 56 and 57, there are three 
examples of physics assessment items. 
Table A3. 2 in Appendix 3 shows the per- 
centage of students in every country 
responding correctly to each of these 
example items. 

Figure 19 is an example of a mechanics 
item. Forty-one percent of U.S. physics 
students responded correctly to this 
item. The international average was 
about 70 percent. Some students who 
responded incorrectly appear not to 
have recognized that the pressure of the 
water would cause the horizontal place- 
ment of the streams to differ. Figure 20 
is an example of a heat item. Forty-nine 
percent of U.S. physics students chose 
the correct answer. The international 
average on this item was 41 percent cor- 
rect. Many students who responded 
incorrectly chose “A.” 
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FIGURE 18: 

Achievement in Physics Content Areas 



MECHANICS 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
HIGHER THAN THE U.S. 



NATION 


AVERAGE 


NORWAY 


572 


SWEDEN 


563 


(SLOVENIA) 


552 


(RUSSIAN FEDERATION) 537 


(CYPRUS) 


530 


(DENMARK) 


529 


GREECE 


514 


(AUSTRALIA) 


507 


(GERMANY) 


495 


(LATVIA) 


489 


SWITZERLAND 


482 


(CANADA) 


473 


CZECH REPUBLIC 


469 


FRANCE 


457 



NATIONS WITH 
AVERAGE SCORES NOT 
SIGNIFICANTLY 
DIFFERENT FROM THE U.S. 



NATION 


AVERAGE 


(AUSTRIA) 


420 


(UNITED STATES) 


420 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
LOWER THAN THE U.S. 



NATION AVERAGE 



NONE 



INTERNATIONAL AVERAGE = 501 



ELECTRICITY/MAGNETISM 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
HIGHER THAN THE U.S. 



NATION 


AVERAGE 


SWEDEN 


570 


NORWAY 


565 


(RUSSIAN FEDERATION) 549 


GREECE 


520 


(DENMARK) 


513 


(AUSTRALIA) 


512 


(GERMANY) 


512 


(SLOVENIA) 


509 


(CYPRUS) 


502 


FRANCE 


494 


(CANADA) 


485 


(LATVIA) 


485 


SWITZERLAND 


480 


CZECH REPUBLIC 


465 



NATIONS WITH 
AVERAGE SCORES NOT 
SIGNIFICANTLY 
DIFFERENT FROM THE U.S. 



NATION 


AVERAGE 


(AUSTRIA) 


432 


(UNITED STATES) 


420 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
LOWER THAN THE U.S. 



NATION AVERAGE 



NONE 



INTERNATIONAL AVERAGE = 501 



HEAT 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
HIGHER THAN THE U.S. 


NATION 


AVERAGE 


NORWAY 




536 


(RUSSIAN FEDERATION) 


530 


SWEDEN 




522 


(SLOVENIA) 




521 


(AUSTRALIA) 




517 


(DENMARK) 




512 


SWITZERLAND 




509 


(CANADA) 




508 


FRANCE* 
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NATIONS WITH 
AVERAGE SCORES NOT 
SIGNIFICANTLY 
DIFFERENT FROM THE U.S. 



NATION AVERAGE 



(LATVIA) 


504 


(GERMANY) 


496 


: CZECH REPUBLIC 


488 


; GREECE 


481 


1 (UNITED STATES) 


477 


(CYPRUS) 


476 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
LOWER THAN THE U.S. 



NATION AVERAGE 



(AUSTRIA) 445 



INTERNATIONAL AVERAGE = 501 
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FIGURE 18 (continued): 
Achievement in Physics Content Areas 



WAVE PHENOMENA MODERN PHYSICS 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
HIGHER THAN THE U.S. 


NATION 


AVERAGE 


NORWAY 


576 


SWEDEN 


560 


(GERMANY) 


545 


(DENMARK) 


544 


(RUSSIAN FEDERATION) 542 


(AUSTRALIA) 


521 


(SLOVENIA) 


511 


(CANADA) 


494 


SWITZERLAND 


488 


(AUSTRIA) 


480 


FRANCE 


474 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
HIGHER THAN THE U.S. 


NATION AVERAGE 


NORWAY 


560 


SWEDEN 


560 


(DENMARK) 


537 


(GERMANY) 


530 


(AUSTRALIA) 


519 


(RUSSIAN FEDERATION) 


515 


(SLOVENIA) 


514 


(CYPRUS) 


507 


SWITZERLAND 


498 


(CANADA) 


488 



NATIONS WITH 
AVERAGE SCORES NOT 
SIGNIFICANTLY 
DIFFERENT FROM THE U.S. 


NATION AVERAGE 


(LATVIA)* 


498 


(AUSTRIA) 


468 


FRANCE 


463 


GREECE 


453 


(UNITED STATES) 


451 


CZECH REPUBLIC 


447 



NATIONS WITH 




AVERAGE SCORES NOT 


SIGNIFICANTLY 




DIFFERENT FROM THE U.S. 


NATION AVERAGE 


(LATVIA)* 


488 


(UNITED STATES) 


456 


CZECH REPUBLIC 


453 


GREECE 


447 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
LOWER THAN THE U.S. 



NATION AVERAGE 



NONE 



NATIONS WITH AVERAGE 
SCORES SIGNIFICANTLY 
LOWER THAN THE U.S. 



NATION AVERAGE 



(CYPRUS ) 434 



INTERNATIONAL AVERAGE = 500 INTERNATIONAL AVERAGE = 501 



♦The placement of Latvia on wave phenomena and modern physics, and France on heat, may appear out of place; 
however, statistically their placement is correct 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix 1 
for details for each country. 



SOURCE: Mull is et al. ( 1 998). Maihematics Achievement in the Final Year of Secondary School. Table 9. 1 . Chestnut Hill, 
MA: Boston College. 
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FIGURE 19: 

Example 10: Mechanics Item 



The figure shows a common plastic bottle (1 L) filled with water and with three 
holes in it so that the water runs out of the holes. 




Explain what is wrong with the figure. 

Correct Answer Example 

• "The pressure will increase with depth due to water above, so the water jets 
will have other pathsr 

US. Average: 41 percent International Average: 70 percent 

SOURCE: Third International Mathematics and Science Study, 1994-1995. 



FIGURE 20: 

Example 1 1 : Heat Item 



A jar of oxygen gas and a jar of hydrogen gas are at the same temperature. 
Which of the following has the same value for the molecules of both gases? 

A. the average velocity 

B. the average momentum 

C. the average force 

D. the average kinetic energy 



Correct Answer: D US. Average: 49 percent International Average: 41 percent 



SOURCE: Third International Mathematics and Science Study, 1994-1995. 






FIGURE 21: 

Example 12: Wave Phenomena Item 



A car moving at a constant speed with a siren sounding comes towards you and 
then passes by. Describe how the frequency of the sound you hear changes. 



Correct Answer Examples 

• “ The pitch is higher os the cor comes closer and lower otter it goes by.” 

• "When the cor approaches, the wavelength of the sound is shorter than it is 
when the cor moves away” 

USAverage: 12 percent International Average: 37 percent 

SOURCE: Third International Mathematics and Science Study, 1994-1995. 



A third example of a physics item con- 
cerns wave phenomena, as shown in Fig- 
ure 21. This proved to be a difficult item 
for most students, including U.S. stu- 
dents. Twelve percent of U.S. physics 
students received at least partial credit 
for this item, and the international 
average was approximately 37 percent cor- 
rect. Some students who responded incor- 
rectly to this item did not adequately disr 
tinguish between the loudness of the 
sound and a change in the wave frequency. 

Is There A Gender Cap In Physics At 
The Twelfth Grade? 

In the United States, as in all the other 
TIMSS nations except Latvia, twelfth- 
grade males outperformed twelfth-grade 
females in physics. In the United States, 
this gender gap existed in 4 of the 5 con- 
tent areas of physics included in the 
TIMSS assessment (all except heat). More 
than three-quarters of the countries had a 
significant gender gap in the content 
areas of mechanics, wave phenomena, 
and modem physics. (See Tables A5.10 
and A5.11 in Appendix 5.) 



How Does U.S. Student Performance 
In Physics Compare To That In 
Advanced Mathematics? 

Unlike our performance on the general 
knowledge portion of the assessment 
(Mhere U.S. students’ relative perfor- 
mance was stronger in science than it was 
in mathematics), U.S. performance on the 
physics assessment was weaker relative to 
other countries than on the advanced 
mathematics assessment Fourteen coun- 
tries scored above the U.S. in the physics 
assessment, while fewer countries (II 
countries) outperformed the U.S. in the 
advanced mathematics assessment. 

The relationship between performance in 
physics and advanced mathematics might 
be more similar to the pattern in general 
knowledge assessments (with students per- 
forming better in science than in mathe- 
matics) if TIMSS had assessed other con- 
tent areas of science such as life science or 
environmental issues and the nature of sci- 
ence, as was done in eighth grade. Among 
the content areas of the science assessment 
given to eighth graders, U.S. students’ per- 
formance was weakest in physics and 
strongest in life science and in environ- 
mental issues and the nature of science. 
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CHAPTER 4: 
THE CONTEXT OF 
LEARNING 

KEY POOMTS; 



It is too early in the process of data 
analysis to provide strong evidence to 
suggest factors that may be related to the 
patterns of performance described here. 



While secondary education in the United 
States differs from that in many of the 
other countries on important dimensions, 
few of those differences are clearly related 
to the relatively poor performance of our 
twelfth graders on theTIMSS assessments. 

The lives of United States graduating 
students differ from those of their peers in 
other countries on several of the factors 
examined. Where there are differences, 
few appear to be systematically related to 
U.S. performance in twelfth grade 
compared to the other countries 
participating in TIMSS. 



Further analyses are needed to provide 
more definitive insights on these subjects. 
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Chapters 2 and 3 have portrayed how 
U.S. high school students in the spring 
of their senior year performed in 
mathematics and science compared to 
their peers at the end of secondary 
school in many other countries. 
Generally, the performance of these 
U.S. students did not compare favorably 
with that of students in the other coun- 
tries participating in TIMSS. The results 
from previous international assessments 
have generally shown that U.S. perfor- 
mance relative to other countries was 
lower at higher grade levels and a 
similar pattern emerged in TIMSS, with 
the strongest U.S. performance in 
fourth grade and the poorest at the end 
of secondary schooling. 

This chapter uses data from TIMSS and 
other sources to examine a number of 
factors that could contribute to the poor 
performance of U.S. twelfth graders. 
Most of the factors examined in this 
chapter are ones that previous research 
has shown to be associated with varia- 
tion in student performance within the 
United States or which observers have 
suggested could be associated with dif- 
ferences in performance between coun- 
tries. (See Appendix 5 for details.) 

Since we are primarily interested in 
identifying factors that might account 
for the relatively poor performance of 



U.S. students, we did not use the 
strategy of looking for factors that 
account for variation across all the 
countries. Instead, we used the 
following two-step process: For each 

potential explanatory factor, the first 
step was to determine whether each of 
the other TIMSS countries were 
significantly higher or lower or were 
similar to the United States on that 
factor. The second step was to examine 
whether the countries that outper- 
formed the United States differed on 
that factor from the United States and 
from countries that performed similarly 
to or below the United States.^ 

The first section of the chapter examines 
factors that might be associated with the 
performance of U.S. twelfth graders on 
the general knowledge assessments 
relative to students in other countries. 
The second section examines factors that 
might be associated with our relative per- 
formance on the physics and advanced 
mathematics assessments. Both sections 
are organized in the following manner. 
First the factors are discussed, focusing on 
how the United States compares to the 
other countries on each one. Then, those 
factors that seem to be related to the U.S. 
performance compared to the other 
countries are identified and discussed. 
(At the end of the first section, there is 
also a discussion of two factors that might 



'' Such an approach to the data w-as chosen for this initial analysis in part because the data for individual 
students were not yet av-ailable for any country except the United States. In addition, since the analysis 
had to be conducted on country-level data, where there were at most 21 cases (i.e., the maximum 
number of countries for any of the assessments), more sophisticated statistical analysis was unlikely 
to detect any relationships unless the relationships were very pronounced. Two byproducts of using 
such an approach should be noted. First, if there are any factors on which the United States differs 
from all the other countries, those factors cannot explain the U.S. relative performance, since the 
U.S. would differ on that factor both from the countries that outperformed us and the ones that did 
not. Second, because the United States \N^as outperformed by all the participating countries except 
one (Austria) on the physics assessment, we are unlikely to find any factors on which the United 
States (and Austria) differ from all the other countries. In a few cases, the analysis had only one step, 
namely to calculate and compare the average for the factor in question (e.g., GNP per capita) for two 
groups of countries: those that outperformed the United Suites and those that did not. 



be related to the lower relative standing of 
U.S. students in twelfth grade than in 
eighth grade.) Figures 25-27 and 29 sum- 
marize the findings of these analyses. 

To simplify the discussion, the analyses 
about fectors related to U.S. internation- 
al standing on the general knowledge 
assessments focused on the mathematics 
general knowledge assessment, rather 
than looking both at mathematics and at 
science general knowledge performance. 
More countries outperformed the Unit- 
ed States in mathematics than in science 
general knowledge and all the countries 
that outperformed the United States in 
science outperformed us in mathematics 
general knowledge as well. 

THE CONTEXT OF LEARNING FOR 
STUDENTS PARTICIPATING IN THE 
GENERAL KNOWLEDGE 
ASSESSMENTS 

The way in which countries structure 
and provide secondary education, or 
high school as it is known in the United 
States, differs gready around the world. 
Among the nations participating in 
TIMSS, different policy decisions, cul- 
tural beliefs about how best to develop 
students’ potential, and other factors 
result in differences in secondary educa- 
tion such as school types, enrollment, 
the courses students take, course curric- 
ula, and financial support for schools. In 
some cases, these differences are more 
pronounced than in others. TIMSS pro- 
vides an opportunity to examine 
whether these differences in education 
systems are related to what students 
know in mathematics and science at the 
end of their secondary schooling. 

Some have argued in the past that 
because the secondary education systems 
in many other countries are quite differ- 



ent from those in the United States, it is 
inp^ppropriate to compare the perfor- 
mance of U.S. students with those in 
other countries. The feet that other coun- 
tiies differ in the decisions they have 
made about the nature of secondary edu- 
cation provides an opportunity to exam- 
ine whether these differences in 
education systems are related to what 
students know at the end of their 
secondary schooling in mathematics and 
science. In addition, understanding 
something about the differences between 
education systems provides important 
information for interpreting the findings 
about student performance. 

How Does Secondary Schooling In 
The Other TIMSS Countries 
Resemble And Differ From That In 
The United States? 

Structure of Secondary Education 

One major way in which the organiza- 
tion of schooling in the United States 
differs from that in many of the TIMSS 
countries is the amount of differentia- 
tion within secondary education. This 
differentiation can take at least two 
forms. One involves the extent to which 
students are separated into different 
programs, either within schools or 
between schools. The other is whether 
the length of secondary schooling is the 
same for all students — across all schools, 
programs, and regions of the country. 
The United States is atypical among 
TIMSS countries in the lack of differen- 
tiation in secondary schooling on either 
dimension. 

The United States was one of five coun- 
tries in TIMSS (the others are also for- 
mer English colonies — ^Australia, Cana- 
da, New Zealand, and South Africa) 
where most students attend comprehen- 
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sive high schools, regardless of their 
ability, prior academic performance, 
and career goals (see Table A5.12 in 
Appendix 5). Within those comprehen- 
sive high schools, students select their 
courses each yean Although there are 
graduation requirements in terms of the 
number of courses students must 
complete in specified fields, students 
generally can enroll in any course for 
which they meet the prerequisites. 

Most of the students in other TIMSS 
countries attend either specialized or 
mixed secondary schools. In specialized 
schools, students of different abilities or 
career goals attend separate types of 
schools. Although in some of these 
countries students have varying degrees 
of choice regarding their school type or 
program of study, once they enroll in a 
particular school or program, the specif- 
ic courses they will take are generally 
fixed. In mixed secondary schools, stu- 
dents of different abilities or career 
goals all attend the same school, but 
based on ability or interest, students are 
divided into one of several pre-set pro- 
grams of coursework within the school. 

In 6 of the TIMSS countries, including 
the United States, secondary schooling 
ends at the same grade for all students. 
In the other 17 countries participating 
in some facet of TIMSS at this level, the 
length of schooling varies (Figure 22). 
Generally, vocationally-oriented pro- 
grams involve fewer years of secondary 
schooling than do those ^vith an acade- 
mic focus. For example, in the Czech 
Republic, there are three types of sec- 
ondary schools — gymnasium (academic), 
technical, and vocational — and depend- 
ing on the school or program, students 
complete secondary schooling at the 
end of grades 10, II, 12, or 13. Students 
in technical schools and gymnasium usu- 



ally complete their secondary education 
at grade 12, but a few end at grade 13. In 
the vocational schools, the end of sec- 
ondary education can occur between 
grades 10 and 13 depending on the type 
of vocation. In some countries, after 
completing one secondary vocational 
program, students may enroll in a 
second such program in another field. 

In TIMSS, students were tested in the 
final year of secondary education 
regardless of their type of school or pro- 
gram, so that within the same country, 
students who took TIMSS varied in the 
number of years of schooling they had 
completed. Thus, in the Czech Republic, 
when TIMSS tested students in the final 
year of secondary school in each type of 
school, there were Czech students tak- 
ing TIMSS who were in grades 10 to 13. 
Across all 21 countries participating in 
the general knowledge portions of 
TIMSS, students as low as grade 10 and 
as high as grade 14 were tested (Table 
A5.13 in Appendix 5). Like the United 
States, eveiy country assessed students 
in grade 12 (except the Russian Federa- 
tion where students complete general 
secondary school at grade 11), but in 
the majority of countries students in at 
least one other grade also participated 
in TIMSS. 

Reflecting the differences in the structure 
and organization of the education systems 
in the various countries, the average age 
of the students in each country taking the 
general knowiedge assessments also var- 
ied across countries, from about 17 to 21 
(Table A5.13 in Appendix 5). The average 
age of U.S. students ^vas 18.1 years and the 
international average for all 21 countries 
in the general knowledge assessments was 
18.7 years. Countries with relatively high 
average ages (19.0 or above) tended to be 
countries where primary school does not 



FIGURE 22 

Age Beginning Grade 1 and Grade(s) Marking End of 
Secondary School in TIMSS Nations 



AGE AT GRADE 1 GRADE 

NATION 

AUSTRALIA 

AUSTRIA 
CANADA 
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NEW ZEALAND 
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NOTE: The width of the bar segments do not indicate the proportion of the cohort that complete school at the 
end of the indicated grades. 

SOURCE: Mullis et al. (1998). Mothemot/cs and Science Achievement in the Final Year of Secondary School. 

Appendix A. Chestnut Hill, MA: Boston College. 
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start until age 7 and/or where sec- 
ondary schooling extends beyond grade 
12. Most of these countries have much 
higher proportions of 18-year-olds 
enrolled in secondary school than the 
United States and some have one-fourth 
to one-third of 20-year-olds still enrolled 
in secondary school (compared to 2 
percent of 20-year-olds in the United 
States). (See Table A5.14 in Appendix 5.) 

Secondary Enrollment and Completion 

One possible explanation for the poor 
performance of U.S. students might be 
that a much higher proportion of the 
U.S. population completes secondary 
education than in the countries that out- 
performed the U.S. on TIMSS. If that 
were the case, then the students partici- 
pating in the TIMSS general knowledge 
assessments would represent an elite 
group within other countries while they 
would represent nearly all the popula- 
tion in the United States. However, data 
gathered as part of TIMSS and by the 
Organization for Economic Coopera- 
tion and Development (OECD) on sec- 
ondary enrollment and completion 
indicate that this is not the case. 

While in the past, it was true that the 
United States differed from many other 
countries in educating most of its young 
people through the end of secondary 
school, that was no longer true in the 
year TIMSS was conducted. In the 
TIMSS countries as a whole, large pro- 
portions of the population now attend 
and complete secondary school (Table 
A5.14 in Appendix 5). In 1995, enroll- 
ment in secondary education represent- 
ed, on average, over 90 percent of chil- 
dren of secondary school age among all 
21 countries participating in the general 
knowledge portion of TIMSS as well as 
in the United States. 



While current secondary enrollment in 
the United States and the other TIMSS 
countries is similar, the United States 
still has an edge in secondary comple- 
tions among a somewhat older age 
group, reflecting differences in sec- 
ondary enrollment in past years. Data 
collected by OECD reveal that in 1995 
the average proportion of the popula- 
tion ages 25-34 who had completed high 
school, while relatively high (78 per- 
cent) for the 14 TIMSS countries for 
which the information was available, was 
somewhat lower than in the United 
States (87 percent).*^ 

Curriculum 

Although the general knowledge 
assessments were not designed to match 
secondary mathematics and science cur- 
ricula, the content of the U.S. secondary 
curriculum relative to the other TIMSS 
countries might contribute to the poor 
U.S. performance. A comparison of the 
topics covered in the mathematics and 
science general knowledge assessments 
with curriculum frameworks did reveal 
that both general knowledge assess- 
ments covered content that is intro- 
duced later in the U.S. curriculum than 
it is introduced, on average, in the other 
TIMSS countries as a whole.*'‘ 

The content of the mathematics general 
knowledge assessment represented 
about a seventh-grade level of curricu- 
lum for most TIMSS nations, but was 
most equivalent to the ninth-grade cur- 
riculum in the United States. The sci- 
ence general knowledge content was 
most equivalent to ninth-grade curricu- 
lum internationally, and to eleventh- 
grade curriculum in the United States. 
The higher grade-level equivalent of the 
assessments in the United States reflects 
the relatively late appearance of algebra 
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and many geometry topics in 
mathematics, and of chemistry and 
physics in science in the U.S. curriculum 
compared to their appearance in the 
curriculum of other countries. 

Another aspect of curriculum that dif- 
fers among the TIMSS countries is the 
extent to which final approval about cur- 
riculum syllabi is centralized. In about 
half of the TIMSS countries, decisions 
about curriculum syllabi are centralized 
at the national level. That is, the nation- 
al level of government has exclusive 
responsibility for or gives final approval 
of the syllabi for courses of study. 

In a few countries, such curriculum 
decisions are regionally centralized, and 
in the remaining countries, including the 
United States, final approval of curricu- 
lum syllabi are not centralized (Table 
A5.15 in Appendix 5). 

Support for Education 

One factor that may be associated with 
both education system and student dif- 
ferences is the affluence of the coun- 
tries, which may be translated into the 
level of resources available to schools 
and families. The United States was one 
of the more affluent countries with a 
GNP per capita of $25,860 compared to 
$17,305 for all 21 countries participat- 
ing in the general knowledge portion of 
TIMSS (Table A5.16 in Appendix 5). 
However, about one-third of the coun- 
tries had GNP per capita similar to or 
higher than the United States ($23,500 
to $37,000). Similarly, the United States 
had higher per capita public spending 
on elementary/secondary education 
than two-thirds of the other countries. It 
should be noted that the U.S. perfor- 
mance resembled, on average, the eco- 
nomically less-affluent countries (those 



with lower GNPs per capita and lower 
per capita expenditures on elemen- 
tary/secondary education) participating 
in the general knowledge assessments, 
while two of the less affluent countries 
(Hungary and Slovenia) also outper- 
formed the United States. 

We now turn our attention to the extent 
to which the United States is similar to 
or differs from the other TIMSS nations 
on factors related to the everyday lives of 
students both within and outside of 
school. 

How Do U.S. Twelfth-Grade 
Students Compare Internationally 
On Factors Associated With Their 
Lives Inside And Outside Of School? 

As discussed above, we know that upper 
secondary education, or “high school” 
as it is known in the United States, varies 
gready among the TIMSS nations. Stu- 
dents in one country may attend a 
school with a particular focus based on 
their abilities or career goals, while stu- 
dents in another country may be 
required to choose among several spe- 
cialties as their “major” in a general 
school. In other countries, students may 
create their own program by choosing 
among a variety of courses. 

While we know much about the differ- 
ences between school systems in the 
TIMSS nations, we know less about stu- 
dents’ everyday lives in those schools, 
and, in particular, how aspects of their 
everyday lives may affect their perfor- 
mance. In order to learn more, TIMSS 
asked all students about a number of 
factors that are related to student per- 
formance within the United States and 
many other countries. For a few coun- 
tries, information is not available for 
some of the factors. 
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Based on students’ reports, TIMSS finds 
the following concerning those students 
who took the general knowledge assess- 
ments, (See Table A5.20 in Appendix 5 
for a detailed summary of these results.) 

Mathematics and Science Coursetaking 

Countries may vary in how much mathe- 
matics and science students take in sec- 
ondary school and at what level. 
Research has shown in the United States 
that more years of science and mathe- 
matics coursetaking in high school are 
associated with higher levels of perfor- 
mance. If a similar pattern holds in 
other countries and greater proportions 
of students in high-achieving countries 
have studied mathematics and science 
for more years or have taken advanced 
courses than in the United States, that 
could contribute to the relatively poor 
performance of U.S. students. 

Because of the differences in the ways 
the curriculum is delivered in the vari- 
ous countries, it is difficult to construct 
comparable measures for the amount or 
the level of mathematics and science 
that students in different countries have 
studied. Students were asked whether 
they were currently taking mathematics 
and science at the time they participated 
in TIMSS, which at least indicates 
whether they were still studying these 
subjects in their final year of secondary 
school. Countries did vary considerably 
in the proportion of students reporting 
they were currently taking mathematics 
(from about half to all students) and sci- 
ence (from one-third to all students). 

U.S. graduating students were less likely 
to be taking mathematics or science than 
were their counterparts in other coun- 
tries. While 66 percent of graduating 
students in the U.S. were currently 



taking mathematics, the average in all 
the countries participating in the 
general knowledge assessments was 79 
percent. The same pattern was also true 
for science (53 percent for the United 
States and 67 percent for all the TIMSS 
countries). 

Homework 

One factor that could be related to U.S. 
students’ performance is the amount of 
homework and studying they do. U.S. 
students reported spending fewer hours 
on homework and studying per day than 
the international average for students in 
the final year of secondary school (1,7 
and 2.6 hours respectively). Students in 
15 nations (out of 19) reported spend- 
ing more hours, on average, studying or 
doing homework per day than their U.S, 
counterparts, while students in only one 
nation, the Czech Republic, reported a 
lower average number of hours studying 
or doing homework per day. (See table 
A5.20 in Appendix 5.) 

Calculators and Computers 

There is considerable discussion in the 
U.S. about how and to what extent 
calculators and computers should be 
incorporated into classroom instnaction 
in mathematics and science. TIMSS 
asked students about their usage of 
calculators and computers in many set- 
tings — at home, school, and elsewhere. 
U.S. students’ use of calculators was sim- 
ilar to that of students in other countries. 
About half of U.S. twelfth-grade students 
(52 percent) reported using a calculator 
on a daily basis, which is similar to the 
international average (55 percent) . 






In all nations, students were given the 
opportunity to use calculators if they 
wished to do so during the TIMSS math- 
ematics and science general knowledge 
assessments. While a majority of U.S. stu- 
dents reported taking advantage of the 
opportunity to use calculators during the 
mathematics and science general 
knowledge assessments, a smaller pro- 
portion of U.S. students did so than the 
international average (71 and 79 percent, 
respectively). More students took advan- 
tage of the opportunity in 12 nations 
than did students in the United States. 

About three-quarters of U.S. twelfth- 
grade students reported using a com- 
puter at school, home, or elsewhere, 
which is higher than the international 
average (73 and 57 percent, respectively). 

Attitudes Toward Mathematics and 
Science 

Perhaps U.S. students do less well 
because they have less positive attitudes 
toward mathematics and science. About 
21 percent of U.S. twelfth graders said 
they liked mathematics a lot, which was 
higher than the international average of 
15 percent. 

Students were asked whether they liked 
biology, chemistry, earth science, and 
physics. For chemistry, earth science and 
physics, the percentage of U.S. students 
who said that they liked the subject or 
who liked it a lot (49, 68, and 47 percent 
respectively) was higher than the inter- 
national average (42, 63, and 42 percent 
respectively). The percentage of U.S. 
students who said they liked biology or 
who liked biology a lot was 67, the same 
as the international average. 



Personal Safety in School 

The school emaronment should be con- 
ducive to learning. One factor that may 
detract from the amount of learning that 
takes place is a school environment where 
students’ safety is somewhat problematic. 
Students in TIMSS were asked about 
thefts and threats in school. The United 
States was above the international average 
in both. 

About one-quarter of U.S. twelfth-graders 
had experienced theft of their property at 
school in the month prior to the assess- 
ments, which was higher than the interna- 
tional average (Figure 23). Theft was 
experienced by a smaller percentage of 
students in 15 nations (out of 17). 

While less common than theft in most 
nations around the world, approximately 
one-tenth of U.S. twelfth-grade students 
reported having been threatened at 
school in the month prior to TIMSS, 
which was higher than the international 
average (Figure 23). In only one other 
nation. South Africa, did a larger 
percentage of students report ha^^ng been 
threatened than did students in the Unit- 
ed States. Threats of violence at school 
were experienced by a smaller percentage 
of students in 10 nations (out of 16). 

Television and Video Watching 

The amount of television students watch is 
often mentioned as a factor related to 
achievement. U.S. twelfth graders spent, 
on average, the same amoimt of time 
watching television or videos as the inter- 
national average. U.S. students watched 
an average of 1.7 hours of television or 
videos on a normal school day, which was 
the same amount of time as the average 
for the 20 countries for which data were 
available. 
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Working at a Paid Job 

Students at the end of secondary school 
may spend their out-of-school time in a 
variety of ways other than studying and 
doing homework. If students work long 
hours, at part-time jobs, that may leave 
them with less time and energy to 
devote to school. More U.S. twelfth- 
grade students reported that they 
worked at a paid job, and worked longer 
hours, on a normal school day, than did 
students in any other TIMSS nation 
(Figure 24), A little more than half of 
U.S, students said that they worked 3 or 
more hours on a normal school day at a 
paid Job compared with the internation- 
al average of about one-fifth of all 



graduating students. Moreover, U.S. stu- 
dents reported that they worked an aver- 
age of 3.1 hours on a normal school day, 
which was higher than for students in 
any other TIMSS nation. 

Which Of These Factors Related To 
Education Systems And Students Are 
Associated With The Relatively Poor 
Performance Of U.S. Twelfth 
Graders In TIMSS On The General 
Knowledge Assessments? 

Most of the factors described above do 
not seem to account for U.S. students’ 
relatively poor performance. Among 
the factors related to the education sys- 
tems, this is the case for differentiation 



FIGURE 23: 

U.S. Twelfth-Grade Students’ Reports on Personal Safety at School in Comparison 
WITH THE International Average 
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SOURCE: Mullis et al. (1998). Madiematics and Science Achievement in the Final Year of Secondary School. 
Table 4.2 1 . Chestnut Hill, MA: Boston College. 



in the secondary education system, the 
grade level of the students participating 
in TIMSS, rates of secondary enrollment 
and completion, and centralization of 
decision-making about curriculum syl- 
labi (Figures 25 and 26). Only the aver- 
age age of the students taking the gener- 
al knowledge assessments and the cur- 
ricular-level equivalent of those assess- 
ments seem to be possible factors con- 
tributing to the relatively poor U.S. per- 
formance on these assessments. 

While the average age of the students 
participating in TIMSS in the countries 
outperforming the United States ranged 
from 17.5 to 21.2 years, countries with 



an average age of 19.0 or above were 
somewhat more likely to outscore the 
United States than the countries in 
which the average age was less than 19.0. 

The content of the general knowledge 
assessments represented material cov- 
ered at a higher grade level in the Unit- 
ed States than the other countries as a 
whole. However, estimates for the 
grade-level equivalents of the assess- 
ments for each of the other TIMSS 
countries individually are not currently 
available. Therefore, we cannot current- 
ly compare how the assessments corre- 
spond to the curriculum in the countries 
that outperformed the United States to 



FIGURE 24: 

U.S. Twelfth-Grade Students’ Reports on Hours on a Normal School Day Spent 
Working at a Paid Job in Comparison with the International Average 
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FIGURE 25: 

Relationship Between U.S. Relative Performance and Schooling and Student PAaoRs: 
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NO 


A5.20 


HOURS OF HOMEWORK 


BELOW 


NO 


A5.20 


DAILY USE OF CALCULATORS 


SAME 


NO 


A5.20 


CALCULATOR USE ON TIMSS 


BELOW 


YES 


A5.20 


USE OF COMPUTERS 


ABOVE 


NO 


A5.20 


POSITIVE AUITUDES TOWARD 
MATHEMATICS 


ABOVE 


NO 


A5.20 


THEROF PROPERTY AT 
SCHOOL 


ABOVE 


NO 


A5.20 


PERSONAL THREATS AT 
SCHOOL 


ABOVE 


NO 


A5.20 


AVERAGE HOURS WATCHING 
TV OR VIDEOS 


SAME 


NO 


A5.20 


AVERAGE HOURS WORKING 
AT A PAID JOB ON A NORMAL 
SCHOOL DAY 


ABOVE 


NO 


A5.20 



— Data not available. 



1. Based on how the United States compares to the international average for theTIMSS countries for which data 
were available. 

2. Based on whether the factor was associated with the relatively poor performance of the United States compared 
to the other participating countries. 

SOURCES: Mullis et al. (1998). Mathematics and Sdence Achievement in the Final Year of Secondary School. Chestnut 
Hill, MA: Boston College; and Organisation for Economic Cooperation and Development. (1997). Education at a 
Clance:OECD Indicators 1997. Paris: OECD. 



FIGURE 26: 

Relationship Between U.S. Relative Performance and Schooling and Student Factors: 

Science General Knowledge 



FACTORS 



U.S. COMPARED TO 
INTERNATIONAL 
AVERAGE ON THE 
FACTOR' 



FACTOR 

ASSOCIATED WITH 
U.S. RELATIVE 
PERFORMANCE' 



APPENDIX TABLE 
WITH 

SUPPORTING 

INFORMATION 



SCIENCE 

GENERAL KNOWLEDGE 



CURRICULAR GRADE-LEVEL 
EQUIVALENT OF THE 
ASSESSMENT 


ABOVE 




NONE 


TAKING SCIENCE IN FINAL 
YEAR OF SECONDARY 
SCHOOL 


BELOW 


NO 


A5.20 


POSITIVE AHITUDES TOWARD 
CHEMISTRY 


ABOVE 


NO 


A5.20 


POSITIVE AHITUDES TOWARD 
EARTH SCIENCE 


ABOVE 


NO 


A5.20 


POSITIVE AHITUDES TOWARD 
PHYSICS 


ABOVE 


NO 


A5.20 


POSITIVE AHITUDES TOWARD 
BIOLOGY 


SAME 


NO 


A5.20 



— Data not available. 

1 . Based on how the United States compares to the international average for theTIMSS countries for which data 
were available. 

2. Based on whether the factor was associated with the relatively poor performance of the United States compared 
to the other participating countries. 



SOURCE: Mullis et al. ( 1 998). Mothemot/cs and Science Achievennent in the Final Year of Secondary School. Chestnut 
Hill, MA: Boston College. 




f 





how they correspond to the United 
States and the countries that performed 
similarly or worse than we did. 

Most of the factors related to students’ 
lives do not seem to account for U.S, 
students’ relatively poor performance 
either. Among these factors, this is the 
case for mathematics and science 
coursetaking during the final year of 
secondary school, hours spent on 
homework or studying, the use of calcu- 
lators, the use of computers, positive 
attitudes toward mathematics and sci- 
ence, personal safety in school, televi- 
sion and video watching, and hours 
spent working at a paid job. Only the 
percentage of students using a calcula- 
tor during the TIMSS mathematics gen- 
eral knowledge assessment is related to 
the U.S. performance on the mathemat- 
ics general knowledge assessment rela- 
tive to the other TIMSS nations. 

Countries in which a higher percentage 
of students used a calculator on the 
TIMSS mathematics general knowledge 
assessment were more likely to outper- 
form the United States than countries 
with a similar or lower percentage of 
student calculator use on the mathemat- 
ics general knowledge assessment. 
Eleven of the 12 countries with higher 
student calculator use during the TIMSS 
assessment than the United States per- 
formed better than the United States in 
mathematics general knowledge. More- 
over, 5 of the 8 countries with similar or 
lower student calculator use during the 
assessment than the United States per- 
formed similar to or lower than the 
United States in mathematics general 
knowledge. However, it is unclear 
whether using a calculator helped 
students score higher on the TIMSS 
mathematics general knowledge assess- 
ment, or whether more able students 



were more likely to use a calculator on 
the assessment. 

While most of the factors examined 
above do not appear to be associated 
with the relatively poor performance of 
the United States at twelfth grade in 
comparison with other nations, we now 
turn to the question of whether any of 
these same factors can explain the dif- 
ferences in the relative performance of 
U.S. students in TIMSS at eighth grade 
and at twelfth grade. 

Why Do U.S. Students Perform 
More Poorly Relative To The 
International Average At The End Of 
Secondary Schooling Than In Eighth 
Grade? 

The performance of all U.S. students 
was poorer in twelfth grade than in 
eighth grade relative to the other 19 
countries which participated in TIMSS 
at both levels. One factor that does seem 
to be associated with whether countries’ 
relative position differed between the 
eighth grade and the end of secondary 
school general knowledge assessments is 
the average age of the students 
participating in the two assessments in 
each country (Figure 27). 

As indicated previously, there was 
considerable variation across the 
countries in the average age of students 
participating in the general knowledge 
assessments. This variation reflects two 
factors: the age at which students begin 
first grade (six in most countries, seven 
in a few) and the highest grade in sec- 
ondary education (ranging from 10 to 
14, depending on the country and the 
student’s program). In countries where 
some of the students participating in the 
end of secondary school assessment 
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FIGURE 27: 

Relationship Between U.S. Relative Performance and Education System Factors: 
Grade Eight and End of Secondary School 



FACTORS 


U.S. COMPARED TO 
INTERNATIONAL 
AVERAGE ON THE 
FACTOR' 


FACTOR ASSOCIATED 
WITH DIFFERENCE IN 
RELATIVE 

PERFORMANCE IN 
EIGHTH GRADE AND 
END OF SCHOOL 
ASSESSMENTS’ 


APPENDIX TABLE WITH 
SUPPORTING 
INFORMATION 


MATHEMATICS 


AGE OF STUDENTS IN END 
OF SECONDARY SCHOOL 
ASSESSMENT 


BELOW 


YES 


A5.17 


PROPORTION CURRENTLY 
TAKING MATHEMATICS 
AT END OF 

SECONDARY SCHOOL 


BELOW 


NO 


A5.18 


SCIENCE 


AGE OF STUDENTS IN END 
OF SECONDARY SCHOOL 
ASSESSMENT 


BELOW 


YES 


A5.19 


PROPORTION CURRENTLY 
TAKING SCIENCE 
AT END OF 

SECONDARY SCHOOL 


BELOW 


NO 


A5.18 



1. Based on how the United States compares to the international average for theTIMSS countries for which data 
were available. 

2. Based on whether the factor was associated with the lower relative standing of the United States compared to 
the international average in twelfth grade than in eighth grade. 



SOURCE: Mullis et al. (1998). Mothemotics and Science Achievement in the Final Year of Secondary School. Chestnut 
Hill, MA: Boston College. 



were in gr^^.des above 12, the average age 
tended to be older. As a result, the aver- 
age age of students taking the end of sec- 
ondary school assessment ranged from 
16.9 to 21.2 years. 

There was also variation, though less so, 
in the average age of students participat- 
ing in the middle school assessment. 
The targeted population in that assess- 
ment was the two grades with the largest 
number of 13-year olds at the beginning 
of the school year. In most countries, the 
grades were seven and eight, but in a few 



countries — generally those in which first 
grade begins at age seven — the grades 
assessed were six and seven. The “eighth 
grade” comparisons were based on 
eighth graders for the former countries 
and seventh graders for the latter. 
Although the ages were generally com- 
parable across countries, the average age 
for each country was affected by factors 
such as the exact timing of the assess- 
ment and the variation in age within 
grades. The country averages for stu- 
dents in the eighth grade comparisons 
ranged from 13.6 to 15.4 years. 




In the countries whose standing relative 
to the international average was more 
favorable at the end of secondary 
schooling than in eighth grade, the 
average age of the students participating 
in TIMSS tended to be younger than the 
international average in the “eighth 
grade” assessment and older than the 
international average in the end of 
school assessment. In addition, in those 
countries whose relative position was 
less favorable in the end of school 
assessment than it was in the eighth 
grade assessment, the average age of the 
students participating in the end of 
school assessment tended to be below 
the average, Miiich was the case for the 
United States. 

As a result of these patterns, the differ- 
ence between the average age of the stu- 
dents participating in the two assess- 
ments was greater for countries whose 
relative standing was more favorable at 
the end of secondary schooling than for 
countries whose relative standing was less 
favorable at the end of secondary school- 
ing than in eighth grade. On average, the 
difference in age of the students partici- 
pating in the two assessments was about 5 
years 3 months in countries whose rela- 
tive standing was more favorable at the 
end of secondary schooling and 3 years 6 
months in countries with a less-favorable 
standing at the end of secondary school 
(Tables A5.17 and A5.19 in Appendix 5). 

Countries \diere more students were tak- 
ing mathematics in their final year of sec- 
ondary school were not more likely to 
have a higher relative standing in twelfth 
grade compared to their standing in 
eighth grade. In feet, for mathematics. 



countries whose relative standing was less 
fevorable in twelfth grade had a higher 
proportion of students enrolled in mathe- 
matics in the final year of secondary 
schooling, on average, than did those 
whose relative standing was higher in 
twelfth grade, although this pattern did 
not hold for the United States. The Unit- 
ed States was the only country whose rela- 
tive standing was lower in twelfth grade 
where the proportion of students current- 
ly taking mathematics was below the inter- 
national average. 

We now turn our attention to examining 
the context in which advanced mathemat- 
ics and physics students learn. 

THE CONTEXT OF LEARNING FOR 
ADVANCED MATHEMATICS AND 
SCIENCE STUDENTS IN THE FINAL 
YEAR OF SECONDARY SCHOOL 

Decisions made by nations in how they 
structure and provide secondary educa- 
tion affect all students, including 
advanced mathematics and science stu- 
dents. This section examines how differ- 
ences in the delivery and implementa- 
tion of advanced mathematics and sci- 
ence courses among the TIMSS nations 
relate to the performance of advanced 
mathematics and science students. In 
particular, this section will focus on 
advanced science and mathematics stu- 
dents’ everyday experiences in school 
and the classroom to learn more about 
how aspects of their school lives may be 
related to performance in physics and 
advanced mathematics. 









How Do U.S. Physics and Advanced 
Mathematics Students Compare 
Internationally on Factors 
Associated With Their Lives In 
School? 

Unlike a number of their U.S. peers, 
most advanced mathematics and 
advanced science students continue to 
take mathematics or science courses in 
their final year of secondary school. To 
take advantage of this fact, TIMSS asked 
physics and advanced mathematics stu- 
dents for information about their class- 
room experiences in those subjects. 

Results from TIMSS indicate the follow- 
ing information about students who 
took the physics and advanced mathe- 
matics assessments. (See Tables A5.21 
and A5.22 in Appendix 5 for detailed 
summary information.) 

Homework 

Students enroUed in mathematics and in 
physics in the last year of secondary 
school were asked how frequendy they 
were assigned homework in these sub- 
jects. U.S. twelfth-grade physics and 
advanced mathematics students more fre- 
quency reported being assigned home- 
work three or more times per week than 
the international average. Half of U.S. 
twelfth-grade physics students (51 per- 
cent) reported being assigned physics 
homework three or more times a week 
compared to the international average of 
forty percent for advanced science stu- 
dents. Among advanced mathematics stu- 
dents, 90 percent of U.S. students report- 
ed this much homework in mathematics, 
while the international average was 65 
percent. 



Calculators 

A higher percentage of U.S. physics and 
advanced mathematics students reported 
usii^ a calculator on a daily basis than 
their international counterparts. Approx- 
imately 80 percent of both U.S. advanced 
mathematics and physics students 
reported using a calculator on a daily 
basis. The international average for both 
subjects was about 70 percent. As with the 
mathematics and science general 
knowledge assessments, students in all 
TIMSS nations were provided the 
opportunity to use calculators during 
the physics and advanced mathematics 
assessments. More U.S. students who 
took the advanced mathematics assess- 
ment reported using a calculator during 
the assessment (86 percent) than the 
international average (76 percent). 
Among U.S. students who took the 
physics assessment, 81 percent of stu- 
dents reported using a calculator during 
the assessment, similar to the interna- 
tional average (79 percent). 

Hours of Instruction 

TIMSS asked physics and advanced math- 
ematics students to report on the number 
of hours of mathematics or physics 
instruction they received each week. 
Among U.S. twelfth-grade advanced 
mathematics students who were currently 
taking a mathematics course, a much 
lower percentage reported receivii^ five 
or more hours of mathematics instruction 
per week than the international average. 
Twelve percent of U.S. advanced mathe- 
matics students stated that they received 
five or more hours of mathematics 
instruction per week, compared to an 
international average of 39 percent. 
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In physics, the pattern was the reverse. 
A higher percentage of U.S. twelfth- 
grade physics students currently taking 
physics reported receivii^ five or more 
hours of physics instruction per week 
than the international average. Seventeen 
percent of U.S. physics students stated 
that they received five or more hours of 
physics instruction per week; the interna- 
tional average was 8 percent. 

Computers 

TIMSS queried students in advanced 
mathematics or physics courses about 
using computers to solve exercises or 
problems in their lessons. U.S. students 
were more likely to report using a com- 
puter in these subjects than the interna- 
tional average. Thirty-four percent of 
U.S. advanced mathematics and 42 per- 
cent of U.S. physics students reported 
being asked to use a computer to solve 
exercises or problems during at least 
some lessons, which is higher than the 
international average for both groups, 
28 percent and 29 percent respectively. 

Reasoning Tasks 

Among the many aspects of classroom 
instruction that experts have targeted for 
improvement is providing opportunities 
for students to develop and improve 
their reasoning skills. To obtain a mea- 
sure of how often students are asked to 
do reasoning tasks in class, TIMSS 
queried students whether they have 
been asked by their teachers to do any of 
the following: explain their reasoning 
behind an idea; represent and analyze 



relationships using tables, charts, or 
graphs; work on problems for which 
there is no immediately obvious method 
or solution; or write equations to repre- 
sent relationships. Based on the 
responses to these questions, U.S. stu- 
dents in both subjects were more likely 
to report being asked to do reasoning 
tasks than the international average. 
Forty-three percent of U.S. twelfth-grade 
advanced mathematics students report- 
ed that they were asked to do at least 
one of these reasoning tasks in “every 
mathematics lesson,” while the interna- 
tional average was 32 percent. Among 
U.S. physics students, 36 percent 
reported that they were asked to do at 
least one of these reasoning tasks in 
“every physics lesson,” compared to the 
international average of approximately 
23 percent. 

Laboratory Experiments 

Another area of education that has 
received much attention is the use of 
experiments to enhance students’ 
learning of concepts and knowledge in 
science. When queried whether they 
were asked to conduct laboratory 
experiments diuing physics lessons, 96 
percent of U.S. physics students replied 
affirmatively, which was higher than the 
international average (79 percent) of 
advanced science students who replied 
similarly. More U.S. physics students 
stated that they were asked to conduct 
laboratory experiments than students in 
10 of the 15 other TIMSS nations that 
participated in the physics assessment. 



Connecting Mathematics to Everyday 
Problems 

Some experts believe that one way to 
improve students’ interest in mathematics 
is to connect it to everyday, real-world 
problems rather than just to abstract 
concepts. U.S. advanced mathematics 
students were more likely to report that 
they were asked to connect mathematics 
to everyday problems, than the 
international average (85 and 68 percent 
respectively) (Figure 28). More U.S. 
advanced mathematics students reported 
that they were asked to apply mathematics 
to everyday problems in their 
mathematics lessons than students in 13 of 
the 15 other nations that participated in 
the advanced mathematics assessment. 



Are Any Of These Instructional 
Experiences Of Physics And 
Advanced Mathematics Students 
Associated With U.S. Relative 
Performance? 

There does not appear to be a relation- 
ship between student performance in 
physics or advanced mathematics and 
most other instructional factors related 
to advanced mathematics and physics 
(see Figure 29 and Tables A5.21 and 
A5.22 in Appendix 5). Only the per- 
centage of advanced mathematics stu- 
dents who received five hours or more 
of mathematics instruction per week was 
related to the U.S. performance relative 
to the other participating countries. 



FIGURE 28: 

Advanced Mathematics Students* Reports on Connecting Mathematics to 
Everyday Problems 
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U United States 
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SOURCE: Mullis et al. (1998). Mathematics and Science Achievement in the Final Year of Secondary School. 
Table 7.4. Chestnut Hill, M A: Boston College. 
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FIGURE 29: 

Relationship Between U.S. Relative Performance and Instructional Factors: 
Physics and Advanced Mathematics Students 
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FACTOR 

ASSOCIATED WITH 
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APPENDIX TABLE 
WITH SUPPORTING 
INFORMATION 


ADVANCED MATHEMATICS 


HOMEWORK ASSIGNMENTS 


ABOVE 


NO 


A5.21 


DAILY USE OF CALCULATOR 


ABOVE 


NO 


A5.21 


CALCU ATOR USE ON TIMSS 


ABOVE 


NO 


A5.21 


HOURS OF INSTRUCTION 


BELOW 


YES 


A5.21 


USE OF COMPUTER IN 
LESSONS 


ABOVE 


NO 


A5.21 


ASKED TO DO REASONING 
TASKS IN LESSONS 


ABOVE 


NO 


A5.21 


CONNECT MATHEMATICS TO 
EVERYDAY PROBLEMS 
IN LESSONS 


ABOVE 


NO 


A5.21 


PHYSICS 


HOMEWORK ASSIGNMENTS 


ABOVE 


NO 


A5.22 


DAILY USE OF CALCU ATOR 


ABOVE 


NO 


A5.22 


CALCU ATOR USE ON TIMSS 


SAME 


NO 


A5.22 


HOURS OF INSTRUCTION 


ABOVE 


NO 


A5.22 


USE OF COMPUTER IN 
LESSONS 


ABOVE 


NO 


A5.22 


ASKED TO DO 

REASONING TASKS IN LESSONS 


ABOVE 


NO 


A5.22 


ABORATORY EXPERIMENTS 
IN LESSONS 


ABOVE 


NO 


A5.22 



1. Based on how the United States compares to the international average for theTIMSS countries participating in 
the assessment. 

2. Based on v^ether the factor was associated with the relatively poor performance of the United States on the 
assessment compared to the other participating countries. 

SOURCE: Mullis et al. (1998). MaU)ematics and Science Achievement in the Final Year of Secondary School. Chestnut 
Hill, MA: Boston College. 





Countries in which a higher percentage 
of advanced mathematics students 
received five or more hours of mathe- 
matics instruction per week were more 
likely to outperform the U.S. than coun- 
tries with a similar or lower percentage of 
students receiving that amoimt of instruc- 
tion. All seven countries in which a high- 
er proportion of advanced mathematics 
students received five or more hours of 
mathematics instruction per week out- 
performed the United States on the 
advanced mathematics assessment. Of 
the seven countries in which the 
advanced mathematics students were no 
more likely than U.S. students to receive 
five or more hours of mathematics 
instruction per week, three performed 
similar to and four outperformed the 
United States. 

A similar pattern was not found for the 
amount of physics instruction that 
advanced science students received per 
week. However, it should be noted that 
students were asked about the amount of 
instruction they received in physics, not 
in all science courses that they were tak- 
ing. In many of the TIMSS countries, a 
substantial proportion of students take 
more than one science course in the final 
year of secondary school.'® 



DISCUSSION 

We have examined the early evidence 
from TIMSS and other sources com- 
paring the United States to the inter- 
national average of TIMSS countries 
on various factors that many experts 
believe are related to educational per- 
formance. When appropriate, we have 
examined whether these differences are 
associated with the relatively low perfor- 
mance of the United States in the TIMSS 
mathematics and science general knowl- 
edge, advanced mathematics, and 
physics assessments. Initial evidence 
does not point definitively to any factor, 
or group of factors, that would explain 
U.S. students’ performance in compari- 
son with their international peers. 

We did note, however, that two factors — 
the average age of students at the time of 
the assessment and the percentage of 
students who reported using a calculator 
during the assessment — ^were associated 
with U.S. students* general knowledge of 
mathematics compared to students in 
other countries. Also, one factor — the 
percentage of students who received at 
least five hours of mathematics instruc- 
tion per week — was associated with the 
relative performance of the students in 
advanced mathematics. 

In addition, one factor that appears to be 
associated with differences in countries’ 
relative position between eighth grade 
and the end of secondary school is the 
average age of the students participating 
in the two assessments in each country. 



@ 



Further analyses may reveal underlying 
patterns that are not apparent in these 
initial results. For example, while the 
factors we have examined may not 
explain our performance relative to 
most of the countries that outper- 
formed us, some could be influential 
relative to at least one of the countries. 
Furthermore, many of these factors are - 
inter-related and this analysis looked at 
each factor separately. 

It is important to note that while most of 
the student characteristics that we exam- 
ined did not explain U.S. performance 
relative to other countries, many were 
related to individual student perfor- 
mance within the United States and 



other countries. For example, although 
country averages for television watching, 
homework, and mathematics and sci- 
ence course-taking were not related to 
average performance, individual stu- 
dents who watched less television, did 
more homework, and took mathematics 
and science during the final year of sec- 
ondary school generally outperformed 
their peers. While this may seem 
counter-intuitive, it can arise when there 
are country-level factors that influence 
performance for all students in a similar 
manner. Additional analyses are needed 
to understand more fully the interrela- 
tionships among individual and country- 
level factors. 
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This report has presented highlights 
from the initial analyses of the academic 
performance of the U.S. twelfth graders 
in comparison with performance of stu- 
dents from other countries at the end of 
secondary education. The performance 
of U. S. students in mathematics and sci- 
ence at the end of secondary school is 
among the lowest of those countries par- 
ticipating in TIMSS. This is true for all 
students as well as for students in 
advanced mathematics and in physics. 

The report has also presented the evi- 
dence available from early analyses con- 
cerning why U.S. students’ performance 
is one of the lowest among the partici- 
pating TIMSS countries. TIMSS does 
not suggest any single factor or combi- 
nation of factors that can explain why 



our performance is so low. From our ini- 
tial analyses, it also appears that some 
factors commonly thought to influence 
individual student performance are not 
strongly related to performance when 
comparing average student perfor- 
mance across countries. 

TIMSS provides a rich source of infor- 
mation about student performance in 
mathematics and science and about 
education in other countries. These ini- 
tial findings suggest that to use the study 
most effectively, we need to pursue the 
data beyond this initial report, taking 
the opportunity and time to look at 
interrelationships among factors in 
greater depth. 



WORKS 

CITED 



1. National Council of Teachers of 

Mathematics. (1989). Curriculum and 
Evaluation Standards for School Mathemat- 
ics. Reston, VA: National Council of 

Teachers of Mathematics. 

2. National Council of Teachers of 

Mathematics. (1991). Professional Stan- 
dards for Teaching Mathematics. Reston, 
VA: National Council of Teachers of 

Mathematics. 

3. American Association for the 
Advancement of Science. (1993). 
Benchmarks for Science Literacy. New York: 
Oxford Press. 

4. National Academy of Sciences. 
(1996). National Science Education Stan- 
dards. Washington, DC: National Acade- 
my Press. 

5. Mullis, I.V.S., Martin, M.O., Beaton, 
A.E., Gonzalez, E.J., Kelly, D.L., and 
Smith, T.A. (1998). Mathematics and 
Science Achievement in the Final Year of 
Secondary School. Chestnut Hill, MA: 
Boston College. 

6. Elley, W.B. (1992). How in the World 
Do Students Read? The Hague, Nether- 
lands: International Association for the 
Evaluation of Educational Achievement. 

7. Pelgrum, H. and Plomp, T. (1993). 
International lEA Computers in Education 
Study. New York: Pergamon Press. 

8. U.S. Department of Education, 
National Center for Education Statistics. 
(1996). Pursuing Excellence: A Study of 



U.S. Eighth-Grade Mathematics and Science 
Teachings Learningy Curriculumy and 
Achievement in International Context. 
NCES 97-198. Washington, DC: National 
Center for Education Statistics. 

9. U.S. Department of Education, 
National Center for Education Statistics. 
(1997). Pursuing Excellence: A Study of 
U.S. Fourth-Grade Mathematics and Science 
Achievement in International Context. 
NCES 97-255. Washington, DC: National 
Center for Education Statistics. 

10. Martin, M. and Kelly, D. (1996). 
Third International Mathematics and Sci- 
ence Study: Technical Reporty Volume 1: 
Design and Development. Chestnut Hill, 
MA: Boston College; and Martin, M. and 
Mullis, I.V.S. (1996). Third International 
Mathematics and Science Study: Quality 
Assurance in Data Collection. Chestnut 
Hill, MA: Boston College. 

11. Mullis, I.V.S. , Martin, M.O., Beaton, 
A.E., Gonzalez, E.J., Kelly, D.L., and 
Smith, T.A. (1998). Mathematics and 
Science Achievement in the Final Year of 
Secondary School. Chestnut Hill, MA: 
Boston College. 

12. Carey, N., Farris, E., and Carpenter, J. 
(1994). Curricular Differentiation in 
Public High Schools. NCES 95-360. 
Washington, DC: National Center for 
Education Statistics. 

13. Organisation for Economic Cooper- 
ation and Development. (1997). Edu- 
cation at a Glance: OECD Indicators 1 997. 
Paris: OECD. 





81 



14. Schmidt, W. (forthcoming). Facing 
the Consequences: Using TIMSS for a Closer 
Look at United States Mathematics and Sci- 
ence Education. Hingham, MA: Kluwer. 

15. Madigan, T. (1997). Science Proficiency 
and Course Taking in High School NCES 
97-838. Washington, DC: National Cen- 
ter for Education Statistics; Rock, D., 
and Pollack, J.(1995). Mathematics 
Course-Taking and Gains in Mathematics 
Achievement. NCES 95-714. Washington, 
DC: National Center for Education 
Statistics; Owings, J.A. and Lee, R. 
(1994). Changes in Math Proficiency 
between 8th and 10th Grade. NCES 93-455. 
Washington, DC: National Center for 
Education Statistics; and Hoffer, T.B., 
Radinski, K.A., and Moore, W. (1995). 
Social Background Differences in High 
School Mathematics and Science Coursetak- 
ing and Achievement. NCES 95-206. 
Washington, DC: National Center for 
Education Statistics. 

16. Mullis, I.V.S., Martin, M.O., Beaton, 
A.E., Gonzalez, E.J., Kelly, D.L., and 
Smith, T.A. (1998). Mathematics and 
Science Achievement in the Final Year of 
Secondary School. Chestnut Hill, MA: 
Boston College. 

17. Ibid. (1998). 




83 , 






82 



APPENDICES 



A PPENDIX 1 

SUMMARY OF INTERNATIONAL STUDY GUIDELINES AND 
DEFINITION OF ELIGIBLE STUDENTS 



Twenty-three nations participated in the 
study. Twenty-one participated in the 
general assessments, while two other 
nations (Greece and Latvia) only partici- 
pated in one or both of the advanced 
assessments. 

To identify comparable groups across 
countries for the three assessments, 
TIMSS countries were asked to identify 
eligible students in terms of common 
definitions, after adapting the definitions 
to country-specific situations. Students in 
the mathematics and science general 
knowledge assessments were to be 
in their final year of secondary school. 
For the advanced mathematics 
assessment, eligible students were those 
who had taken or were taking advanced 
courses in mathematics. For the physics 
assessment, students were those who 
had taken or were taking physics. 

The international guidelines specified the 
following sampling standards: 



B the sample was to be representative of 
at least 90 percent of students in the 
total population eligible for the study. 
Therefore, exclusion rates must be 
under 10 percent. 

n the school participation rate without 
the use of replacement schools must 
be at least 50 percent, and 

H the combined participation rate (the 
product of school and student partici- 
pation rates after replacements) must 
be at least 75 percent, or school and 
student participation rates must each 
be 85 percent. 

fl Countries were also required to submit 
a sampling plan for approval by the 
TIMSS International Study Center. 

Most of the TIMSS countries experienced 
some deviation from international guide- 
lines for execution of the study, at the 
end of secondary school, in one or 
more of the assessments. All deviations 
from these guidelines are bolded in the 
tables In Appendix 1. 



TABLEAU 

Nations’ Definitions of Eligible Students and Whether Met Sampling Standards: 
Mathematics and Science General Knowledge Assessments 



Nation 


Population and exclusion rate 


Whether met sampling 
standards 


(AUSTRALIA) 


Students in the final year of secondary 
school. Grade 12, in government. Catholic, 
and independent schools. 

Exclusion rate: 6% 


School participation rate 
before replacement: 49%, 
Combined participation 
rate: 52% 


(AUSTRIA) 


Students in their final year of academic schools 
(Grade 12), their final year of higher technical 
and vocational school (Grade 13), their final 
year of medium technical and vocational 
school (Grades 10, 1 1, or 12 depending on the 
vocational program of the student), and 
students in their final year of apprenticeship 
(Grades 12, 13, or 14). 


School participation rate 
before replacement: 36%, 
Combined participation 
rate: 73% 




Exclusion rote: 18% (students enrolled in 
teacher training colleges and courses lasting 
less than three years excluded). 




(CANADA) 


Students In Grade 12 in all provinces except 
in Grades 13 and 14 (depending on pro- 
gram) in Quebec; in Ontario, also students 
completing the Ontario Academic Credits 
(OAC) in Grade 13. 


School participation rate 
before replacement: 82% 

Combined participation 
rate: 68% 




Exclusion rate: 9% 




(CYPRUS) 


Students in Grade 1 2 of lycea and the techni- 
cal schools. Vocational students in technical 
schools were not tested. Students in the private 
vocational schools were not included. 


School participation rate 
before replacement: 100% 
Combined participation 
rate: 98% 




Exclusion rote: 22% (private and vocational 
schools excluded) 





CZECH 

REPUBLIC 



Students in their find year of each type of 
school. In technical schools and gymnasia, 
students in Grades 12 and 13 were tested. In 
vocational schools students in Grades 10, 11, 
1 2 and 1 3 were tested, depending on their 
vocation. 



School participation rate 
before replacement: 100% 
Combined participation 
rate: 92% 



Exclusion rate: 6% 
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TABLE A1.1 (continued) 

Mathematics and Science General Knowledge Assessments 



Nation 


Population and exclusion rate 


Whether met sampling 
standards 


(DENMARK) 


Students in Grade 1 2 of the general secondary 
and vocational schools were tested; however, 
students finishing their formal schooling after 
Folkeskole (Grade 9) were not tested. 

Exclusion rate: 2% 


Did not follow sampling 
procedures 

School participation rate 
before replacement: 55% 

Combined participation 
rate: 49% 


(FRANCE) 


Students in their final year of preparation for all 
types of the bocco/oureof which includes stu- 
dents in Grade 12 or Grade 13 (depending on 
the type of exam). Also tested were students in 
the final year of preparation for the 
Brevet d 'etudes professiorineHes or the Certificot 
d'apfifude professionneUe who will not continue 
towards a bacco/oureof (Grade 11). 

Exclusion rate: 1% 


School participation rate 
before replacement: 80% 

Combined participation 
rate: 69% 


(GERMANY) 


Students in their final year in the gymnasium 
and the vocatiorxal education programs. This 
corresponded to Grade 1 3 in the Laender of 
the former West Germany and to Grade 1 2 in 
the Laender of the former East Germany. 

Exclusion rote: 11% 


Did not follow sampling 
procedures 

School participation rate 
before replacement: 89% 
Combined participation 
rate: 80% 


HUNGARY 


Students in their final year of academic sec- 
ondary and vocational schools (Grade 1 2) 
and students in the final In-school year of 
trade school (Grade 10). 

Exclusion rate: 0% 


School participation rate 
before replacement: 100% 
Combined participation 
rate: 98% 


(ICELAND) 


Students who were to graduate that year 
from an upper secondary school, that is, stu- 
dents in Grades 12, 13, and 14. 

Exclusion rate: 0% 


School participation rate 
before replacement: 100% 

Combined participation 
rate: 74% 
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TABLEAU (CONTINUED) 

Mathematics and Science General Knowledge Assessments 



Nation 


Population and exclusion rate 


Whether met sampling 
standards 


(ITALY) 


Students in all types of schools in their final year 
of secondary schooi. The finai grade of school 
depended on their focus of study within the 
schooi type, ranging from Grade 1 1 to Grade 
1 3. Students in private schoois were not tested. 


Schooi participation rate 
before repiacement: 60% 

Combined participation 
rate: 62% 




Exclusion rote: 30% (four regions of 20 were 
exciuded). 




(LITHUANIA) 


Students in final year. Grade 12 in vocational 
gymnosio, and secondary schoois where 
Lithuanian is the ianguage of instruction. 
Schoois not under the authority of the Ministry 
of Education or the Ministry of Science were 
exciuded. 


School participation rate 
before repiacement: 97% 
Combined participation 
rate: 85% 




Exclusion rate: 16% (schoois where Lithuanian 
was not the language of instruction). 




(NETHERLANDS) 


Students in finai year, Grade 1 2 of 6-year pre- 
university program; students in finai year. 
Grade 1 1, in 5-year senior generai secondary 
program; and students in the second year. 
Grade 1 2, of a two to four year senior sec- 
ondary vocationai program. Students in 
apprenticeship programs were not tested. 


Did not follow sampling 
procedures 

School participation rate 
before replacement: 36% 
Combined participation 
rate: 49% 




Exclusion rate: 22% (short senior vocationai 
and apprenticeship programs exciuded). 




NEW 

ZEALAND 


Students in Grade 1 2 and students in Grade 1 1 
who were not returning to schooi for Grade 1 2. 

Exciusion rate: 0% 


School participation rate 
before repiacement: 87% 
Combined participation rate: 
81% 


(NORWAY) 


Students in Grade 1 2 in aii areas of study. 
Exciusion rate: 4% 


Schooi participation rate 
before repiacement: 74% 

Combined participation 
rate: 71% 


(RUSSIAN 

FEDERATION) 


Students in finai year, Grade 1 1, of generai 
secondary schooi. Students in vocationai 
programs were not tested. 

Exclusion rate: 43% (vocationai schoois and 
non-Russian speaking students exciuded). 


Schooi participation rate 
before repiacement: 93% 
Combined participation 
rate: 90% 




TABLEAU (continued) 

Mathematics and Science General Knowledge Assessments 



Notion 


Population and exclusion rate 


Whether met sampling \ 
standards 


(SLOVENIA) 


Students in Grade 12 in gymnasia and in 
technicai secondary schoois, and students 
in Grade 1 1 in vocationai schoois. Students 
finishing vocationai schooi in Grades 9 and 
10 were not tested. 

Exciusion rate: 6% 


Did not follow sampling 
procedures 

School participation rate 
before replacement: 46% 
Combined participation 
rate: 42% 


(SOUTH 

AFRICA) 


Students in Grade 12. 
Exciusion rate: 0% 


Did not follow sampling 
procedures 

School participation rate 
before repiacement: 65% 

Combined participation 
rate: 65% 


SWEDEN 


Students in Grade 1 2 in schoois with the new 
three-year upper-secondary schooi system, 
and in the former two- or three-year system, 
students in the finai year. Grade 11 or 12, 
respectiveiy. 

Exciusion rate: 0% 


School participation rate 
before replacement: 95% 
Combined participation 
rate: 82% 


SWITZERLAND 


Students in their finai year of gymnasium, gen- 
erai education, teacher training, and voca- 
tionai training. This corresponded to Grade 1 1 
or 1 2 in gymnasium (finai year depending on 
canton). Grade 1 2 in the generai track; Grade 
1 2 in the teacher-training trade and Grade 1 1 , 
1 2, or 1 3 in the vocationai track (finai year 
varies by occupation). 

Exclusion rate: 3% 


School participation rate 
before replacement: 87% 
Combined participation 
rate: 85% 


(UNITED 

STATES) 


Students in Grade 1 2. 
Exciusion rate: 4% 


School participation rate 
before replacement: 77% 

Combined participation 
rate: 64% 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. Specific 
deviations from these guidelines are bolded. 



SOURCE: Mullis et al. (1998). Mothemot/cs and Science Achievement in the Final Year of Secondary School. 
Appendix A, Tables B.4 and B. 10, and Figure B.4. Chestnut Hill, MA: Boston College. 



TABLE A1. 2 

Nations’ Definitions of Eligible Students and Whether Met Sampling Standards: 
Advanced Mathematics Assessment 



Nation 


Population and exclusion rate* 


Whether met sampling 
standards 


(AUSTRALIA) 


Students In their final year of senior secondary^ 
Grade 1 2, enrolled In mathematics courses 
(varies across states) preparir^g them for post- 
secondary study, and students in Grade 1 2 
who took such mathematics courses during 
Grade 1 1 . 

Exclusion rate: 6% 


School participation rate 
before replacement: 47% 
Combined participation 
rate: 55% 


(AUSTRIA) 


Students in their final year of the academic 
(Grade 12) or higher technical (Grade 13) 
track, taking courses in advanced mathe- 
matics. 

Exclusion rate: 18% (students enrolled in 
teacher training colleges and courses lasting 
less than three years excluded). 


School participation rate 
before replacement: 37% 

Combined participation 
rate: 81% 


CANADA 


Students in their final year in mathematics 
courses preparing them for postsecondary 
study. Grade 12 or 13 (varies by province), 
except in Quebec where students in the 
two-year science program were tested. 

Exclusion rate: 9% 


Schooi participation rate 
before repiacement: 85% 
Combined participation 
rate: 77% 


(CYPRUS) 


Students in their final year (Grade 12) in the 
mathematics/science program of study at 
the lyceum. 

Exclusion rate: 22% (private and vocational 
schools excluded). 


School participation rate 
before repiacement: 100% 
Combined participation 
rate: 96% 


CZECH 


Gymnasium students in their finai year of 


Schooi participation rate 


REPUBLIC 


study. Grade 12 or 13. 
Exciusion rate: 6% 


before replacement: 100% 
Combined participation 
rate: 92% 


(DENMARK) 


Mathematics and physics students in the 
gymnasium and mathematics students in 
their finai year. Grade 12, of the technicai or 
higher preparation tracks. 

Exciusion rate: 2% 


Did not follow sampling 
procedures 

School participation rate 
before replacement: 55% 

Combined participation 
rate: 49% 
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TABLE A 1.2 (continued) 
Advanced Mathematics Assessment 



Nation 


Population and exclusion rate* 


Whether met sampling 
standards 


FRANCE 


Students in their final year of the scientific 
trade Grade 12, preparing the baccalaureat 
general. 

Exclusion rate: 1% 


School participation rate 
before replacement: 90% 
Combined participation rate: 
77% 


(GERMANY) 


Students in their final year, Grade 12 or 13 
depending on the Laender, in advanced 
mathematics courses (three to five periods per 
week). 


School participation rate 
before replacement: 79% 
Combined participation rate: 
78% 




Exdusion rate: 11% 




GREECE 


Students in their final year. Grade 12, of the 
general (academic) Lyceum and of the multi- 
branch Lyceum, taking advanced courses in 
mathematics and/or science in preparation for 
university disciplines requiring mathematics. 


School participation rate 
before replacement: 76% 
Combined participation rate: 
87% 




Exclusion rate: 0% 




(ITALY) 


Students in their final year of Uceo Scienfifico 
(classical schools). Grade 11, 12, or 13, 
depending on the program of study, and 
Insfifufi Techn/c/ (technical schools). Grade 13. 


School participation rate 
before replacement: 70% 

Combined participation rate: 
68% 




Exclusion rote: 30% (four regions of 20 were 
excluded). 




(LITHUANIA) 


Students in their final year, Grade 12, of the 
rrathematics and science gymnasia and stu- 
dents In secondary schools offering enhanced 
curriculum in mathematics. 


School participation rate 
before replacement: 100% 
Combined participation 
rate: 92% 




Exclusion rote: 16% (schools where Lithuanian 
was not the language of instruction). 




(RUSSIAN 

FEDERATION) 


Students in their final year. Grade 1 L in gen- 
eral secondary schools in advanced mathe- 
matics courses or advanced mathematics 
and physics courses. 


School participation rate 
before replacement: 98% 
Combined participation 
rate: 96% 




Exclusion rote: 43% (vocational schools and 
non-Russian speaking students excluded). 







TABLE A 1.2 (continued) 
Advanced Mathematics Assessment 



Nation 


Population and exclusion rate* 


Whether met sampling 
standards 


(SLOVENIA) 


Students in their find year of gymnasium 
and technical and professional schools. 
Grade 12 all of whom were taking 
advanced mathematics courses. 

Exclusion rate: 6% 


Did not follow sampling 
procedures 

School participation rate 
before replacement: 46% 
Combined participation 
rate: 42% 


SWEDEN 


Students in their final year. Grade 12, of the 
Natural Science or Technology lines. 

Exclusion rate: 0% 


School participation rate 
before replacement: 95% 
Combined participation 
rate: 89% 


SWITZERLAND 


Students in their final year. Grade 12 or 13, of 
the scientific track of the Mafurifdfsschufe 
(gymnasium) in schools and programs (A-E) 
with federal recognition. 


School participation rate 
before replacement: 99% 
Combined participation 
rate: 87% 




Exclusion rate: 3% 




(UNITED 

STATES) 


Students in Grade 12 who had taken or 
were taking Advanced Placement calculus, 
calculus, or pre-calculus. 

Exclusion rate: 4% 


School participation rate 
before replacement: 76% 

Combined participation 
rate: 67% 



* Sample exclusion rates are based on all students in the final year of secondary school, not just those eligible to 
participate in the advanced mathematics assessment. 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. Specific 
deviations from these guidelines are bolded. 

SOURCE: Mullis et al. (1998). Mot/iemotics and Science Achievement in the FinalYear of Secondary School 
Appendix A, Tables B.4 and B.l I, and Figure B.5. Chestnut Hill, MA: Boston College. 
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TABLE A1. 3 

Nations* Definitions of Eligible Students and Whether Met Sampling Standards; 

Physics Assessment 



Nation 


Population and exclusion rote* 


Whether met sampling 
standards 


(AUSTRALIA) 


Students In the final year of secondary school 
Grade 12, enrolled In Year 12 physics. 

Exclusion rate: 6% 


School participation rate 
before replacement: 63% 

Combined participation rate: 
54% 


(AUSTRIA) 


Students in their final year of the academic 
(Grade 12) or higher technical (Grade 13) 
track, taking courses in physics. 

Exclusion rote: 1 8% (Students enrolled in 
teacher training colleges and courses lasting 
less than three years excluded). 


School participation rate 
before replacement; 37% 

Combined participation rate: 
81% 


(CANADA) 


Students in their final year in physics courses 
preparing them for post-secondary study. 
Grade 12 or 13 (varies by province), except in 
Quebec where students in the two-year 
science program were tested. 


School participation rate 
before replacement: 80% 

Combined participation rate; 
73% 




Exclusion rate: 9% 




(CYPRUS) 


Students in their final year (Grade 12) of the 
mathematics/science program of study at the 
fyceum. 

Exclusion rate: 22% (private and vocational 
schools excluded). 


School participation rate 
before replacement: 100% 
Combined participation rate: 
96% 


CZECH 

REPUBLIC 


Gymnasium students in their final year of 
study. Grade 12 or 13. 

Exclusion rate: 6% 


School participation rate 
before replacement: 100% 
Combined participation rate: 
92% 


(DENMARK) 


Mathematics and physics students in the 
gymnasium and physics students in their final 
year. Grade 1 2, of the technical track. 

Exclusion rate: 2% 


Did not follow sampling 
procedures 

School participation rate 
before replacement: 55% 

Combined participation rate: 
47% 
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TABLE A1.3 (continued) 
Physics Assessment 



Nation 


Population and exclusion rate* 


Whether met sampling 
standards 


FRANCE 


Students in their final year of the scientific 
trade Grade 12, preparing for the baccalau- 
reat general. 

Exclusion rate: 1 % 


School participation rate 
before replacement: 90% 
Combined participation rate: 
77% 


(GERMANY) 


Students in the final year, Grade 1 2 or 1 3 
depending on the Laender. in physics courses 
(3 to 5 periods per week). 

Exdusion rate: 11% 


School participation rate 
before replacement: 77% 
Combined participation rate: 
82% 


GREECE 


Students in their final year, Grade 12, of the gen- 
eral (academic) Lyceum and the rmilti-branch 
Lyceum taking advarx:ed courses in mathe- 
rTK3tic:s and/or science in preparation for 
university disciplines requiring physics. 


School participation rate 
before replacement: 76% 
Combined participation rate: 
87% 




Exclusion rate: 0% 




(LATVIA) 


Students in Grade 1 2, enrolled in advanced 
physics courses, in Latvian-speaking academ- 
ic secondary schools. 

Exclusion rate: 50% (non-Latvian-speaking 
academic secondary schools). 


School participation rate 
before replacement: 84% 
Combined participation 
rate: 77% 


NORWAY 


Students in their final year. Grade 12 of the 
three-year physics course in the general 
academic branch. 

Exclusion rate: 4% 


School participation rate 
before replacement: 78% 
Combined participation 
rate: 83% 


(RUSSIAN 

FEDERATION) 


Students in their firxil year, Grade 1 1, in general 
secondary schools in advanced physics courses 
or advanced mathematics and physics courses. 

Exclusion rote: 43% (vocational schools and 
non-Russlan-speaking students excluded). 


School participation rate 
before replacement: 98% 
Combined participation 
rate: 95% 


(SLOVENIA) 


Students in their final year of gymnasia, 
Grade 12, taking the physics matura exami- 
nation. 

Exclusion rate: 6% 


Did not follow sampling 
procedures 

School participation rate 
before replacement: 46% 
Combined participation 
rate: 43% 
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TABLE A 1.3 (continued) 
Physics Assessment 




Nation 


Population and exclusion rate* 


Whether met sampling 
standards 


SWEDEN 


Students in their flnai year. Grade 1 2, of the 
Naturai Science or Technoiogy iines. 

Exciusion rate: 0% 


Schooi participation rate 
before repiacement: 95% 
Combined participation rate: 
89% 


SWITZERLAND 


Students In their flnai year, Grade 1 2 or 1 3, of 
the the Mafurifdfsschule (gymnasium) in schoois 
and programs (A-E) with federai recognition. 

Exclusion rate: 3% 


School participation rate 
before repiacement: 99% 
Combined participation rate: 
87% 


(UNITED 

STATES) 


Students in Grade 12 who had taken 
Advanced Piacement physics or physics. 

Exciusion rate: 4% 


Schooi participation rate 
before repiacement: 77% 

Combined participation 
rate: 68% 



* Sample exclusion rates are based on all students in the final year of secondary school, not just those eligible to 
participate in the physics assessment 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. Specific 
deviations from these guidelines are bolded. 

SOURCE: Mullls et al. (1998). /Vlathemat/cs and Science Achievement in the Final Year of Secondary School, 
Appendix A, Tables B.4 and B. 1 2, and Figure B.6, Chestnut Hill, MA: Boston College. 



A PPENDIX 2 

NATIONAL AVERAGE SCORES, PERCENTILES OF 
ACHIEVEMENT, AND STANDARD ERRORS 
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TABLE A2.1 

National Average Scores and Standard Errors; 

Mathematics and Science General Knowledge 

The 95 percent "plus or minus" confidence interval around each nation's score is 
two times the standard error. 





MATHEMATICS 
GENERAL KNOWLEDGE 


SCIENCE 

GENERAL KNOWLEDGE 


NATION 


AVERAGE 


STANDARD 

ERROR 


AVERAGE 


STANDARD 

ERROR 


(AUSTRALIA) 


522 


9.3 


527 


9.8 


(AUSTRIA) 


518 


5.3 


520 


5.6 


(CANADA) 


519 


2.8 


532 


2.6 


(CYPRUS) 


446 


2.5 


448 


3.0 


CZECH REPUBLIC 


466 


12.3 


487 


8.8 


(DENMARK) 


547 


3.3 


509 


3.6 


(FRANCE) 


523 


5.1 


487 


5.1 


(GERMANY) 


495 


5.9 


497 


5.1 


HUNGARY 


483 


3.2 


471 


3.0 


(ICELAND) 


534 


2.0 


549 


1.5 


(ITALY) 


476 


5.5 


475 


5.3 


(LITHUANIA) 


469 


6.1 


461 


5.7 


(NETHERLANDS) 


560 


4.7 


558 


5.3 


NEW ZEALAND 


522 


4.5 


529 


5.2 


(NORWAY) 


528 


4.1 


544 


4.1 


(RUSSIAN FEDERATION) 


471 


6.2 


481 


5.7 


(SLOVENIA) 


512 


8.3 


517 


8.2 


(SOUTH AFRICA) 


356 


8.3 


349 


10.5 


SWEDEN 


552 


4.3 


559 


4.4 


SWITZERLAND 


540 


5.8 


523 


5.3 


(UNITED STATES) 


461 


3.2 


480 


3.3 



mathematics general knowledge international average = 500 

SCIENCE GENERAL KNOWLEDGE INTERNATIONAL AVERAGE = 500 



NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I 
for details for each country. 



al. (1998). MothemoDcs and Science Achievement in the Final Year of Secondary School. Tables 2 I and 
2.2. Chestnut Hill, MA: Boston College. 





TABLE A2.2 

National Average Scores and Standard Errors: 

Physics and Advanced Mathematics 

The 95 percent "plus or minus" confidence interval around each nation's score is 
two times the standard error. 







PHYSICS 


ADVANCED MATHEMATICS 


NATION 


AVERAGE 


STANDARD 

ERROR 


AVERAGE 


STANDARD 

ERROR 


(AUSTRALIA) 


518 


6.2 


525 


11.6 


(AUSTRIA) 


435 


6.4 


436 


7.2 


(CANADA)* 


485 


3.3 


509 


4.3 


(CYPRUS) 


494 


5.8 


518 


4.3 


CZECH REPUBUC 


451 


6.2 


469 


11.2 


(DENMARK) 


534 


4.2 


522 


3.4 


FRANCE 


466 


3.8 


557 


3.9 


(GERMANY) 


522 


11.9 


465 


5.6 


GREECE 


486 


5.6 


513 


6.0 


(ITALY) 


— 


— 


474 


9.6 


(LATVIA) 


488 


21.5 


— 


— 


(LITHUANIA) 


— 


— 


516 


2.6 


NORWAY 


581 


6.5 


— 


— 


(RUSSIAN FEDERATION) 


532 


15.0 


533 


10.5 


(SLOVENIA) 


523 


15.5 


475 


9.2 


SWEDEN 


573 


3.9 


512 


4.4 


SWITZERLAND 


488 


3.5 


533 


5.0 


(UNITED STATES) 


423 


3.3 


442 


5.9 



PHYSICS international average = SOI 

advanced mathematics international average = SOI 

— Data not available because nation did not participate in the assessment. 

* Canada did not meet international sampling and other guidelines for the physics assessment, but did for the 
advanced mathematics assessment. See Appendix I for details. 

NOTE: Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I 
for details for each country. 

SOURCE: Mullis et al. (1998). Mothemat/cs and Science Achievement in the Final Year of Secondary School. Tables 5. 1 
and 8. 1 . Chestnut Hill, MA: Boston College. 






TABLE A2.3 

Percentiles Of Achievement In Mathematics General Knowledge: 
Final Year Of Secondary School 



NATION 


5th Percentile 


25th Percentile 


50th Percentile 


75th Percentile 


95th Percentile 


AVERAGE (S.E.) 


AVERAGE (S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


(AUSTRALIA) 


357 


(17.5) 


459 


(9.4) 


523 


(8.6) 


585 


(9.5) 


684 


(10.4) 


(AUSTRIA) 


393 


(9.2) 


461 


(7.9) 


515 


(6.4) 


573 


(6.4) 


653 


(8.9) 


(CANADA) 


375 


(5.8) 


457 


(4.6) 


516 


(4.5) 


579 


(3.8) 


674 


(5.3) 


(CYPRUS) 


329 


(6.0) 


395 


(2.2) 


442 


(5.0) 


493 


(4.0) 


572 


(3.9) 


CZECH REPUBLIC 


328 


(12.2) 


394 


(10.3) 


450 


(15.9) 


530 


(16.5) 


848 


(13.6) 


(DENMARK) 


406 


(8.2) 


487 


(5.6) 


548 


(6.4) , 


609 


(4.7) 


689 


(6.2) 


(FRANCE) 


392 


(8.6) 


468 


(6.3) 


523 


(3.7) 


578 


(6.9) 


655 


(9-9) 


(GERMANY) 


347 


(10.5) 


432 


(11.3) 


494 


(6.7) 


554 


(8.9) 


652 


(8.0) 


HUNGARY 


343 


(3.8) 


417 


(3.1) 


477 


(3.8) 


545 


(3.5) 


644 


(6.6) 


(ICELAND) 


393 


(5.3) 


472 


(4.0) 


531 


(3.0) 


592 


(3.2) 


683 


(6.6) 


(ITALY) 


336 


(15.3) 


417 


(7.5) 


475 


(6.3) 


534 


(4.6) 


619 


(11.7) 


(LITHUANIA) 


329 


(8.8) 


412 


(9.1) 


470 


(7.0) 


529 


(8.3) 


606 


(5.4) 


(NETHERLANDS) 


407 


(5.7) 


498 


(7.1) 


565 


(6.1) 


622 


(5.2) 


704 


(16.0) 


NEW ZEALAND 


358 


(7.4) 


453 


(7.0) 


523 


(6.3) 


589 


(5.2) 


685 


(6.7) 


(NORWAY) 


384 


(7.7) 


461 


(6.1) 


523 


(4.1) 


592 


(4.5) 


691 


(6.8) 


(RUSSIAN FEDERATION) 


342 


(6.4) 


410 


(4.8) 


464 


(6.0) 


528 


(7.8) 


622 


(16.6) 


(SLOVENIA) 


365 


(13.7) 


451 


(8.5) 


516 


(7.4) 


573 


(6.6) 


652 


(5.7) 


(SOUTH AFRICA) 


264 


(3.2) 


304 


(3.8) 


337 


(4.9) 


380 


(10.4) 


532 


(33.7) 


SWEDEN 


396 


(6.4) 


483 


(5.1) 


546 


(4.8) 


620 


(4.1) 


722 


(6.8) 


SWITZERLAND 


395 


(7.4) 


478 


(7.9) 


539 


(7.9) 


601 


(5.5) 


684 


(5.3) 


(UNITED STATES) 


325 


(4.4) 


395 


(3.8) 


454 


(4.4) 


521 


(6.7) 


621 


(7.4) 



NOTES; 

Nations not meeting international sampling and other guidelines are shown in parentheses See Appendix 1 
for details for each country. 

“S.E.” is standard error. 

SOURCE; Mullis et al. (1998). Mathematics and Science Achievement in the Final Year of Secondary School 
Table E.2. Chestnut Hill, MA: Boston College. ; 




TABLE A2.4 

Percentiles Of Achievement In Science General Knowledge: 
Final Year Of Secondary School 



NATION 


5th Percentile 


25th Percentile 


50th Percentile 


75th Percentile 


95th Percentile 


AVERAGE (S.E.) 


AVERAGE (S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE (S.E.) 


(AUSTRALIA) 


361 


(14.5) 


462 


(12.2) 


525 


(8.5) 


591 


(13.6) 


689 


(4.0) 


(AUSTRIA) 


388 


(5.6) 


460 


(8.3) 


513 


(7.3) 


575 


(9.6) 


672 


(23.5) 


(CANADA) 


396 


(7.1) 


475 


(5.8) 


529 


(3.6) 


588 


(3.8) 


673 


(5.2) 


(CYPRUS) 


319 


(8.7) 


392 


(11.6) 


443 


(5.6) 


499 


(7.5) 


599 


(10.8) 


CZECH REPUBLIC 


349 


(9.5) 


424 


(9.2) 


477 


(11.6) 


540 


(12.1) 


655 


(12.8) 


(DENMARK) 


369 


(6.1) 


448 


(4.9) 


505 


(5.6) 


568 


(7.0) 


657 


(5.4) 


(FRANCE) 


358 


(7.9) 


434 


(5.4) 


485 


(8.4) 


542 


(7.9) 


618 


(5.6) 


(GERMANY) 


350 


(12.2) 


437 


(7.4) 


494 


(6.7) 


556 


(6.3) 


649 


(11.1) 


HUNGARY 


342 


(2.9) 


410 


(3.5) 


463 


(2.2) 


524 


(3.7) 


624 


(6.1) 


(ICEUND) 


429 


(5.0) 


497 


(1.9) 


545 


(3.3) 


598 


(2.1) 


680 


(3.8) 


(ITALY) 


339 


(11.4) 


417 


(6.5) 


470 


(4.6) 


528 


(6.0) 


624 


(17.2) 


(LITHUANIA) 


324 


(13.5) 


403 


(7.5) 


460 


(7.4) 


517 


(4.6) 


601 


(9.1) 


(NETHERUNDS) 


421 


(9.0) 


498 


(6.1) 


556 


(6.4) 


616 


(10.5) 


702 


(19.8) 


NEW ZEAUND 


369 


(16.8) 


467 


(8.9) 


530 


(7.0) 


592 


(4.4) 


683 


(5.2) 


(NORWAY) 


404 


(6.9) 


480 


(5.2) 


539 


(2.7) 


600 


(7.4) 


706 


(11.6) 


(RUSSIAN FEDERATION) 


338 


(6.1) 


418 


(6.9) 


476 


(9.3) 


541 


(9.2) 


638 


(13.7) 


(SLOVENIA) 


384 


(10.1) 


459 


(8.7) 


514 


(8.7) 


571 


(10.3) 


662 


(22.5) 


(SOUTH AFRICA) 


228 


(4.8) 


282 


(4.3) 


325 


(6.3) 


390 


(18.2) 


550 


(22.1) 


SWEDEN 


420 


(9.4) 


495 


(4.3) 


551 


(4.2) 


617 


(5.5) 


724 


(9.2) 


SWITZERUND 


375 


(10.6) 


459 


(6.9) 


521 


(5.0) 


584 


(4.9) 


681 


(9.2) 


{UNITED STATES) 


332 


(8.0) 


416 


(4.6) 


477 


(3.3) 


541 


(4.9) 


640 


(8.0) 



NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix 1 
for details for each country. 

“S.E.” Is standard error. 

SOURCE: Mullis et al. (1998). Mathematics and Science Achievement in the Final Year of Secondary 
School. Table E.3. Chestnut Hill, MA: Boston College. 






TABLE A2.5 

Percentiles Of Achievement In Advanced Mathematics: 
Final Year Of Secondary School 



NATION 


5th Percentile 


25th Percentile 


50th Percentile 


75th Percentile 


95th Percentile 


AVERAGE (S.E.) 


AVERAGE (S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


(AUSTRALIA) 


337 


(30.1) 


456 


(17.5) 


530 


(9.0) 


597 


(10.4) 


692 


(21.1) 


(AUSTRIA) 


283 


(15.2) 


379 


(11.4) 


443 


(7.9) 


497 


(8.8) 


577 


(16.4) 


CANADA 


352 


(7.1) 


443 


(5.4) 


508 


(4.8) 


576 


(7,2) 


676 


(10,1) 


(CYPRUS) 


371 


(23.0) 


465 


(5.7) 


523 


(10.4) 


574 


(5,2) 


651 


(15.8) 


CZECH REPUBLIC 


320 


(12.7) 


399 


(9,2) 


454 


(10,4) 


524 


(15.6) 


665 


(20.2) 


(DENMARK) 


403 


(5.6) 


474 


(3.8) 


523 


(2,3) 


572 


(4.8) 


643 


(6.9) 


FRANCE 


439 


(5.5) 


511 


(5.1) 


558 


(5.5) 


603 


(6.4) 


673 


(8,4) 


(GERMANY) 


328 


(9.3) 


408 


(8.0) 


463 


(5.7) 


522 


(5,6) 


605 


(6,9) 


GREECE 


321 


(35.1) 


454 


(11.6) 


521 


(6.4) 


585 


(5.1) 


668 


(12.7) 


(ITALY) 


314 


(14.9) 


419 


(13.4) 


477 


(10.3) 


534 


(8.3) 


622 


(22.7) 


(LITHUANIA) 


388 


(12.2) 


461 


(5.5) 


512 


(3.6) 


567 


(3.3) 


666 


(16.9) 


(RUSSIAN FEDERATION) 


360 


(9.3) 


465 


(9.3) 


539 


(12.7) 


618 


(9,4) 


730 


(22,4) 


(SLOVENIA) 


330 


(10.2) 


408 


(9.5) 


473 


(10.1) 


537 


(8.5) 


630 


(20,4) 


SWEDEN 


375 


(7.9) 


458 


(10.5) 


513 


(11.4) 


568 


(7,0) 


653 


(13.6) 


SWITZERLAND 


401 


(5.6) 


473 


(6.2) 


525 


(7.9) 


587 


(5.9) 


691 


(3.4) 


(UNITED STATES) 


292 


(3.8) 


375 


(7.1) 


437 


(6.4) 


504 


(6.1) 


609 


(8.9) 



NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix 1 
for details for each country. 

“S.E." is standard error. 



SOURCE: Mullis et al, (1998). Mathematics and Science Achievement in the Final Year of Secondary School. 
Table E.4. Chestnut Hill, MA: Boston College. 





TABLE A2.6 

Percentiles Of Achievement In Physics; 
Final Year Of Secondary School 



NATION 


5th Percentile 


25th Percentile 


50th Percentile 


75th Percentile 


95th Percentile 


AVERAGE 


(S.E.) 


AVERAGE (S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE (S.E.) 


(AUSTRALIA) 


386 


(11.8) 


461 


(3.3) 


517 


(6.6) 


570 


(8.5) 


656 


(11.9) 


(AUSTRIA) 


306 


(11.9) 


379 


(11.3) 


427 


(5.9) 


486 


(10.1) 


581 


(22.3) 


(CANADA) 


346 


(5.1) 


429 


(2.9) 


482 


(4.4) 


539 


(7.3) 


633 


(14.3) 


(CYPRUS) 


325 


(8.0) 


434 


(10.9) 


487 


(4.9) 


551 


(9.0) 


681 


(28.8) 


CZECH REPUBLIC 


337 


(4.5) 


397 


(6.2) 


440 


(6.6) 


493 


(12.3) 


605 


(29.5) 


(DENMARK) 


397 


(8.4) 


478 


(4.3) 


535 


(5.9) 


588 


(6.1) 


677 


(15.2) 


FRANCE 


358 


(9.4) 


423 


(6.8) 


465 


(4.1) 


509 


(3.1) 


574 


(8.3) 


(GERMANY) 


374 


(13.2) 


458 


(16.2) 


519 


(12.0) 


580 


(19.1) 


688 


(10.1) 


GREECE 


333 


(18.9) 


431 


(5.7) 


495 


(7.7) 


545 


(6.3) 


619 


(8.2) 


(UTVIA) 


348 


(12.2) 


418 


(15.7) 


474 


(19.2) 


540 


(36.5) 


687 


(31.5) 


NORWAY 


432 


(6.3) 


517 


(11.1) 


578 


(6.3) 


646 


(7.2) 


727 


(6.1) 


(RUSSIAN FEDERATION) 


368 


(18.2) 


468 


(15.7) 


544 


(12.6) 


619 


(16.5) 


722 


(21.2) 


(SLOVENIA) 


332 


(11.3) 


457 


(15.3) 


528 


(21.2) 


598 


(14.1) 


689 


(36.3) 


SWEDEN 


422 


(12.2) 


511 


(8.9) 


574 


(6.6) 


634 


(6.6) 


725 


(6.7) 


SWITZERLAND 


353 


(20.6) 


430 


(7.6) 


479 


(4.7) 


540 


(5.2) 


648 


(9.9) 


(UNITED STATES) 


331 


(4.7) 


384 


(4.0) 


420 


(4.2) 


458 


(6.4) 


520 


(6.6) 



NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix 1 
for details for each country. 

“S.E.” is standard error. 

SOURCE: Mullis et al. (1998). Mathematics and Science Achievement in the Final Year of Secondary School. 
Table E.5. Chestnut Hill, MA: Boston College. 






A PPENDIX 3 

PERFORMANCE ON ASSESSMENT ITEM EXAMPLES BY COUNTRY 




TABLE A3.1 

Performance on Assessment Item Examples By Country: 
Mathematics and Science General Knowledge 



NATION 


PERCENTAGE OF STUDENTS RESPONDING CORRECTLY 


MATHEMATICS GENERAL 
KNOWLEDGE ITEMS 


SCIENCE GENERAL 
KNOWLEDGE ITEMS 


FIGURE 2 


FIGURE 3 


FIGURE 4 


FIGURE 6 


FIGURE 7 


FIGURE 8 


(AUSTRALIA) 


74.2 


88.4 


50.8 


68.9 


68.3 


52.2 


(AUSTRIA) 


64.6 


84.4 


51.8 


68.5 


74.5 


33.6 


(CANADA) 


74.4 


79.6 


44.7 


69.0 


84.3 


55.0 


(CYPRUS) 


53.2 


53.8 


21.6 


57.7 


82.3 


26.7 


CZECH 

REPUBLIC 


52.6 


65.8 


38.4 


50.2 


91.7 


36.7 


(DENMARK) 


75.0 


78.0 


58.1 


64.4 


83.5 


36.2 


(FRANCE) 


74.0 


71.3 


48.3 


47.8 


86.2 


28.3 


(GERMANY) 


59.1 


74.3 


45.7 


65.3 


66.2 


18.3 


HUNGARY 


65.1 


55.8 


31.6 


67,2 


67.6 


26.6 


(ICELAND) 


73.3 


73,8 


54.4 


78.1 


92.6 


59.8 


(ITALY) 


59.6 


61.9 


33.5 


53.6 


78.0 


23.5 


(LITHUANIA) 


61.2 


61.2 


42.0 


45.3 


68.0 


34.4 


(NETHERLANDS) 


82.5 


91.4 


61.6 


77.9 


88.8 


64.8 


NEW ZEALAND 


75.0 


91.1 


58.9 


67.6 


78,8 


48.9 


(NORWAY) 


67,3 


77.8 


47.3 


71.8 


82.2 


47.9 


(RUSSIAN 

FEDERATION) 


53.7 


61.7 


48.1 


53.0 


66.3 


36.1 


(SLOVENIA) 


63.5 


79.9 


50.6 


71.2 


72.4 


34.8 


(SOUTH AFRICA) 


22.5 


59.6 


14.1 


18.9 


38.7 


11.7 


SWEDEN 


77.5 


84.6 


57.3 


71.8 


92.8 


36.5 


SWITZERLAND 


67.3 


74.7 


59.0 


70.3 


72.9 


28.7 


(UNITED STATES) 


57.4 


84.5 


32.0 


41.7 


77.9 


40.2 


INTERNATIONAL 

AVERAGE 


64.4 


74.0 


45.2 


61.0 


76.9 


37.2 



NOTES: 

Nations not nneeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

International average is the average of the national figures. 

SOURCE: Third International Math and Science Study International Study Center, P-Vo/ueA/monoc for Achievement 
Items. Population 3 - Literacy. Chestnut Hill, MA: Boston College. 
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TABLE A3.2 

Performance on Assessment Item Examples By Country: 
Physics and Advanced Mathematics 



NATION 


PERCENTAGE OF STUDENTS RESPONDING CORREaiY 


ADVANCED 
MATHEMATICS ITEMS 


PHYSICS ITEMS 


FIGURE 13 


FIGURE 14 


FIGURE 15 


FIGURE 19 


FIGURE 20 


FIGURE 21 


(AUSTRALIA) 


60.0 


76.1 


34.5 


51.1 


60.5 


53.3 


(AUSTRIA) 


22.9 


36,6 


19.0 


73.1 


47.9 


50,6 


(CANADA)' 


55.4 


60.9 


28.4 


54.5 


45.1 


22.0 


(CYPRUS) 


62.9 


35.1 


51.2 


91.5 


33.0 


67.9 


CZECH 

REPUBLIC 


44.2 


42.9 


24.6 


70.3 


29.4 


3.5 


(DENMARK) 


39.9 


66.9 


38.7 


77.1 


33.7 


40.9 


FRANCE 


64.5 


61.9 


38.6 


52.5 


16.9 


17.9 


(GERMANY) 


31.1 


46.0 


26.5 


(2) 


42.6 


59.6 


GREECE 


65.5 


29.1 


32.0 


83.2 


52.8 


40.1 


(ITALY) 


45.5 


33.7 


41.8 











(LATVIA) 











66.4 


39.3 


42.9 


(LITHUANIA) 


48.1 


48.9 


31.1 








— 


NORWAY 











81.8 


44.4 


44.5 


(RUSSIAN 

FEDERATION) 


61.7 


35.4 


42.9 


72.0 


43.2 


29.2 


(SLOVENIA) 


39.8 


39.9 


25.2 


82.8 


49.1 


53.8 


SWEDEN 


50.0 


64.4 


48.0 


75.3 


31.5 


19,8 


SWITZERLAND 


62.9 


62.5 


43.6 


71.3 


43.2 


29.7 


(UNITED STATES) 


18.9 


62.4 


27.4 


40.8 


49.0 


12.0 


INTERNATIONAL 

AVERAGE 


45.3 


50.2 


34.6 


69.6 


41.4 


36.7 



— Did not participate in the assessment. 

1. Canada did not meet international sampling and other guidelines for the physics assessment, but did for the 
advanced mathematics assessment. See Appendix I for details. 

2. Data not available. 

NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for details 
for each country. 

International average is the average of the national figures. 

SOURCES: Third International Math and Science Study International Study Center, P-Value Almanac for Achievement 
Items. Population 3 - Advanced Mathematics. Chestnut Hill, MA: Boston College;TIMSS International Study Center, 
P-Value Almanac for Achievement Items. Population 3 - Physics. Chestnut Hill, MA Boston College. 
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SCORES AND STANDARD ERRORS FOR U.S. AP AND NON-AP 
PHYSICS AND CALCULUS STUDENTS 
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TABLE A4.1 

U.S. AP AND Non-AP Calculus Students’ Scores By Content Area 



CONTENT 

AREA 


NON-AP CALCULUS 
STUDENTS 


AP CALCULUS 
STUDENTS 


AVERAGE 

ERROR 


AVERAGE 

ERROR 


NUMBERS AND 
EQUATIONS 


459 7.9 


520 5.2 


CALCULUS 


455 6.8 


523 7.2 


GEOMETRY 


421 8.2 


484 5.3 


OVERALL 


445 8,5 


513 5.4 



SOURCE : Third International Mathematics and Science Study, unpublished tabulations. 



TABLE A4.2 

U.S. AP AND Non-AP Physics Students’ Scores By Content Area 





NON-AP PHYSICS 


AP PHYSICS 


CONTENT 


STUDENTS 


STUDENTS 


AREA 


AVERAGE 


STANDARD 

ERROR 


AVERAGE 


STANDARD 

ERROR 


MECHANICS 


417 


2.6 


460 


8.4 


ELECTRICITY/ 

MAGNETISM 


416 


3.0 


463 


8.9 


HEAT 


474 


3.0 


507 


7.1 


WAVE 

PHENOMENA 


448 


2.3 


487 


6.1 


MODERN 

PHYSICS 


453 


2.2 


497 


10.4 


OVERALL 


418 


3.1 


474 


11.2 



SOURCE : Third International Mathematics and Science Study, unpublished tabulations. 
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A PPENDIX 5 

ADDITIONAL SUPPORTING MATERIALS 
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TABLE A5.1 

Mathematics Performance at Eighth grade and Final Year of Secondary School for 
THE 20 Countries that Participated in TIMSS at Both Grade Levels 



NATION 


STANDING RELATIVE 
TO THE INTERNATIONAL 
AVERAGE’-^ 


EIGHTH 

GRADE 


FINAL 

YEAR 


(AUSTRALIA) 


ABOVE 


SAME 


(AUSTRIA) 


ABOVE 


ABOVE 


(CANADA) 


ABOVE 


ABOVE 


(CYPRUS) 


BELOW 


BELOW 


CZECH REPUBUC 


ABOVE 


SAME 


(DENMARK) 


SAME 


ABOVE 


(FRANCE) 


ABOVE 


ABOVE 


(GERMANY) 


SAME 


SAME 


HUNGARY 


ABOVE 


BELOW 


(ICELAND) 


BELOW 


ABOVE 


(LITHUANIA) 


BELOW 


BELOW 


(NETHERLANDS) 


ABOVE 


ABOVE 


NEW ZEALAND 


SAME 


ABOVE 


(NORWAY) 


BELOW 


ABOVE 


(RUSSIAN FEDERATION) 


ABOVE 


BELOW 


(SLOVENIA) 


ABOVE 


SAME 


(SOUTH AFRICA) 


BELOW 


BELOW 


SWEDEN 


SAME 


ABOVE 


SWITZERLAND 


ABOVE 


ABOVE 


(UNITED STATES) 


SAME^ 


BELOW 



COMPARISON OF STANDING RELATIVE TO 
THE INTERNATIONAL AVERAGE IN 
EIGHTH GRADE AND FINAL YEAR OF 
SECONDARY SCHOOL 



HIGHER IN FINAL YEAR OF 
SECONDARY SCHOOL THAN IN 
EIGHTH GRADE 



(DENMARK)^ 

(ICELAND) 

NEW ZEALAND* 

(NORWAY)^ 

SWEDEN^ 



SIMILAR IN FINAL YEAR OF 
SECONDARY SCHOOL AS IN 
EIGHTH GRADE 


(AUSTRIA) 


(NETHERLANDS) 


(CANADA) 


(SOUTH AFRICA) 


(CYPRUS) 


SWITZERLAND* 


(FRANCE) 




(GERMANY) 




(LITHUANIA) 





LOWER IN FINAL YEAR OF 
SECONDARY SCHOOL THAN IN 
EIGHTH GRADE 



(AUSTRALIA)* 

CZECH REPUBLIC 
HUNGARY 

(RUSSIAN FEDERATION)* 
(SLOVENIA) 

(UNITED STATES) 



1 . Above: Nation's performance higher than the average at that grade for the twenty nations. 

Same: Nation's performance not significantly different from the average at that grade for the twenty nations. 

Below: Nation's performance lower than the average at that grade for the twenty nations. 

2. International average is the average of the national figures for the twenty nations. 

3. U.S. average performance is below the international average based on all 41 countries that participated in the 
eighth grade portion ofTIMSS. 

4. Based on standing relative to the international average in seventh grade. 

5. Based on standing relative to the international average in seventh or eighth grade, depending upon the system In 
place In each canton (Switzerland) or age starting school (Russian Federation). 

6. Based on standing relative to the international average In eighth or ninth grade, depending upon the system in 
place in each state/territory (Australia) or age beginning primary school (New Zealand). 



NOTE: Nations not meeting international sampling and other guidelines in the final year of secondary school 
assessment are shown in parentheses. See Appendix I for details for each country. 



o 
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SOURCE: Mullls et al. (1998). /Vlat/iem<it/cs and Science Achievement in the Final Year of Secondary School. Table 2 and 
Figure 2.3. Chestnut Hill, MA: Boston College., Mullis et al. (1996). /Vlothemot/cs Achievement in the Middle School Years. 
Table 2. Chestnut Hill, MA Boston College. 
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TABLE A5.2 

Mathematics Performance at Fourth Grade and Final Year of Secondary School for 
THE 12 Countries that Participated in TIMSS at Both Grade Levels 



NATION 


STANDING RELATIVE 
TO THE INTERNATIONAL 

AVERAGE’ 2 


FOURTH 

GRADE 


FINAL 

YEAR 


(AUSTRALIA) 


ABOVE 


SAME 


(AUSTRIA) 


ABOVE 


SAME 


(CANADA) 


SAME 


SAME 


(CYPRUS) 


BELOW 


BELOW 


CZECH REPUBUC 


ABOVE 


SAME 


HUNGARY 


ABOVE 


BELOW 


(ICELAND) 


BELOW 


ABOVE 


(NETHERLANDS) 


ABOVE 


ABOVE 


NEW ZEALAND 


BELOW 


SAME 


(NORWAY) 


BELOW 


SAME 


(SLOVENIA) 


ABOVE 


SAME 


(UNITED STATES) 


ABOVE 


BELOW 



COMPARISON OF STANDING RELATIVE TO 
THE INTERNATIONAL AVERAGE IN 
FOURTH GRADE AND FINAL YEAR OF 
SECONDARY SCHOOL 



HIGHER IN FINAL YEAR OF 
SECONDARY SCHOOL THAN IN 
FOURTH GRADE 



(ICELAND) 

NEW ZEALAND^ 
(NORWAY)^ 



SIMILAR IN FINAL YEAR OF 
SECONDARY SCHOOL AS IN 
FOURTH GRADE 

(CANADA) 

(CYPRUS) 

(NETHERLANDS) 



LOWER IN FINAL YEAR OF 
SECONDARY SCHOOL THAN IN 
FOURTH GRADE 

(AUSTRALIA)" 

(AUSTRIA) 

CZECH REPUBLIC 

HUNGARY 

(SLOVENIA) 

(UNITED STATES) 



1. Above: Nation's performance higher than the average at that grade for the twelve nations. 

Same: Nation's performance not significantly different from the average at that grade for the twelve nations. 

Below: Nation's performance lower than the average at that grade for the twelve nations. 

2. International average is the average of the national figures for the twelve nations. 

3. Based on standing relative to international average in third grade. 

4. Based on standing relative to international average in fourth or fifth grade, depending upon the system in place in 
each state/territory (Australia) or age beginning primary school (New Zealand). 



NOTE: Nations not meeting international sampling and other guidelines in the final year of secondary school 
assessment are shown in parentheses. See Appendix I for details for each country. 



SOURCES: Mullis et al. ( 1 998). Mothemot/cs and Science Ac/i/evement in the Final Year af Secandary Schaal. Table 2. 1 . 
Chestnut Hill, MA: Boston College; and Martin et al. (1997). Mothemot/cs Achievement in the Primary Schaal Years. 
Tables 2 and l.l. Chestnut Hill, MA: Boston College. 
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Table A5.3 

Achievement in Mathematics General Knowledge by Gender for 
Students in Their Final Year of Secondary School 



NATION^ 


MALES 


FEMALES 


DIFFERENCE^ 

(S£.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


HUNGARY 


485 


(4.9) 


481 


(4.8) 


5 


(6.9) 


(UNITED STATES) 


466 


(4.1) 


456 


(3.6) 


11 


(5.5) 


(CYPRUS) 


454 


(4.9) 


439 


(3.7) 


15 


(6.1) 


(SOUTH AFRICA) 


365 


(9.3) 


348 


(10.8) 


17 


(14.3) 


(LITHUANIA) 


485 


(7.3) 


461 


(7.7) 


23 


(10.6) 


(ITALY) 


490 


(7.4) 


464 


(6.0) 


26 


(9.5) 


(RUSSIAN FEDERATION) 


488 


(6.5) 


460 


(6.6) 


27 


(9.2) 


(GERMANY) 


509 


(8.8) 


480 


(8.8) 


29 


(12.4) 


NEW ZEALAND 


536 


(4.9) 


507 


(6.2) 


29 


(7.9) 


(AUSTRALIA) 


540 


(10.3) 


510 


(9.3) 


30 


(13.9) 


SWITZERLAND 


555 


(6.4) 


522 


(7.4) 


33 


(9.8) 


(CANADA) 


537 


(3.8) 


504 


(3.5) 


34 


(5.2) 


(FRANCE) 


544 


(5.6) 


506 


(^.3) 


38 


(7.7) 


(AUSTRIA) 


545 


(7.2) 


503 


(5.5) 


41 


(9.0) 


SWEDEN 


573 


(5.9) 


531 


(3.9) 


42 


(7.0) 


(ICELAND) 


558 


(3.4) 


514 


(2.2) 


44 


(4.1) 


CZECH REPUBLIC 


488 


(11.3) 


443 


(16.8) 


45 


(20.2) 


(SLOVENIA) 


535 


(12.7) 


490 


(8.0) 


46 


(15.0) 


(DENMARK) 


575 


(4.0) 


523 


(4.0) 


52 


(5.7) 


(NETHERLANDS) 


585 


(5.6) 


533 


(5.9) 


53 


(8.2) 


(NORWAY) 


555 


(5.3) 


501 


(4.8) 


54 


(7.1) 


INTERNATIONAL AVERAGE 


518 


(1.5) 


485 


(1.6) 


33 


(2.2) 



GENDER DIFFERENCE 
100 75 50 25 0 25 50 75 100 



Females 

Score 

Higher 



Males 

Score 

Higher 









1 



100 75 50 25 



25 50 75 100 



Q Gender differences within country significant 
□ Gender differences within country not agnificant 



1 . Difference is calculated by subtracting average females' score from average males’ score, based on 
unrounded averages. 

2, Nations ordered based on size of difference between males' and females' scores, from lowest to highest. 



NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix 1 for 
details for each country. 

International average is the average of the national figures. 

“S.E." is standard error. 

SOURCE: Mullis et al. (1 998). Mathematics and Science Achievement in the Final Year of Secondary 
School. Table 2.4. Chestnut Hill, MA: Boston College. 



TABLE A5.4 

Science Performance at Eighth grade and Final Year of Secondary School for the 
20 Countries that Participated in TIMSS at Both Grade Levels 



NATION 


STANDING REATIVE 
TO THE INTERNATIONAL 

AVERAGE’ 2 


EIGHTH 

GRADE 


FINAL 

YEAR 


(AUSTRALIA) 


ABOVE 


SAME 


(AUSTRIA) 


ABOVE 


ABOVE 


(CANADA) 


ABOVE 


ABOVE 


(CYPRUS) 


BELOW 


BELOW 


CZECH REPUBLIC 


ABOVE 


SAME 


(DENMARK) 


BELOW 


SAME 


(FRANCE) 


BELOW 


SAME 


(GERMANY) 


ABOVE 


SAME 


HUNGARY 


ABOVE 


BELOW 


(ICELAND) 


BELOW 


ABOVE 


(LITHUANIA) 


BELOW 


BELOW 


(NETHERANDS) 


ABOVE 


ABOVE 


NEW ZEAAND 


SAME 


ABOVE 


(NORWAY) 


ABOVE 


ABOVE 


(RUSSIAN FEDERATION) 


ABOVE 


BELOW 


(SLOVENIA) 


ABOVE 


SAME 


(SOUTH AFRICA) 


BELOW 


BELOW 


SWEDEN 


ABOVE 


ABOVE 


SWITZERAND 


SAME 


ABOVE 


(UNITED STATES) 


ABOVE 


BELOW 



COMPARISON OF STANDING RELATIVE TO 
THE INTERNATIONAL AVERAGE IN 
EIGHTH GRADE AND FINAL YEAR OF 
SECONDARY SCHOOL 



HIGHER IN FINAL YEAR OF SECONDARY 
SCHOOL THAN IN EIGHTH GRADE 



(DENMARK)^ 

(FRANCE) 

(ICELAND) 

NEW ZEAANCH* 
SWITZERAND^ 



SIMILAR IN FINAL YEAR OF SECONDARY 
SCHOOL AS IN EIGHTH GRADE 



(AUSTRIA) 

(CANADA) 

(CYPRUS) 

(LITHUANIA) 

(NETHERANDS) 

(NORWAY)^ 

(SOUTH AFRICA) 

SWEDEN^ 



LOWER IN FINAL YEAR OF SECONDARY 
SCHOOL THAN IN EIGHTH GRADE 



(AUSTRALIA)^ 

CZECH REPUBLIC 
(GERMANY) 

HUNGARY 

(RUSSIAN FEDERATION)^ 
(SLOVENIA) 

(UNITED STATES) 



1 . Above: Nation's performance higher than the average at that grade for the twenty nations. 

Same: Nation's performance not significantly different from the average at that grade for the twenty nations. 
Below: Nation's performance lower than the average at that grade for the twenty nations. 

2. International average is the average of the national figures for the twenty nations. 

3. Based on standing relative to the international average in seventh grade. 

4. Based on standing relative to the international average in eighth or ninth grade, depending upon the system in 
place in each state/territory (Australia) or age beginning primary school (New Zealand). 

5. Based on standing relative to the international average in seventh or eighth grade, depending upon the system in 
place in each canton (Switzerland) or age starting school (Russian Federation). 

NOTE: Nations not meeting international sampling and other guidelines in the final year of secondary school 
assessment are shown in parentheses. See Appendix I for details for each country. 

SOLIRCE: Mullis et al. (1998). Ma^ematics and Science Achievement in the Final Year of Secondary Schoo/. Table 2 and 
Figure 2.4. Chestnut Hill, MA: Boston College., Mullis et al. (1996). Mothemot/cs Achievement in the Middle School Years. 
Table 2. Chestnut Hill. MA: Boston College. 



TABLE A5.5 

Science Performance at Fourth Grade and Final Year of Secondary School 
FOR THE 12 Countries that Participated in TIMSS at Both Grade Levels 



NATION 


STANDING RELATIVE 
TO THE INTERNATIONAL 

AVERAGE' 2 


FOURTH 

GRADE 


FINAL 

YEAR 


(AUSTRALIA) 


ABOVE 


SAME 


(AUSTRIA) 


ABOVE 


SAME 


(CANADA) 


SAME 


ABOVE 


(CYPRUS) 


BELOW 


BELOW 


CZECH REPUBLIC 


ABOVE 


SAME 


HUNGARY 


SAME 


BELOW 


(ICELAND) 


BELOW 


ABOVE 


(NETHERLANDS) 


ABOVE 


ABOVE 


NEW ZEALAND 


SAME 


SAME 


(NORWAY) 


SAME 


ABOVE 


(SLOVENIA) 


SAME 


SAME 


(UNITED STATES) 


ABOVE 


BELOW 



COMPARISON OF STANDING RELATIVE TO 
THE INTERNATIONAL AVERAGE IN 
FOURTH GRADE AND FINAL YEAR OF 
SECONDARY SCHOOL 

HIGHER IN FINAL YEAR OF SECONDARY 
SCHOOL THAN IN FOURTH GRADE 

(CANADA) 

(ICELAND) 

(NORWAY)^ 



SIMILAR IN FINAL YEAR OF SECONDARY 
SCHOOL AS IN FOURTH GRADE 

(CYPRUS) 

(NETHERLANDS) 

NEW ZEALAND^ 

(SLOVENIA) 



LOWER IN FINAL YEAR OF SECONDARY 
SCHOOL THAN IN FOURTH GRADE 

(AUSTRALIA)" 

(AUSTRIA) 

CZECH REPUBLIC 
HUNGARY 

(UNITED STATES) 



1 . Above: Nation's performance higher than the average at that grade for the twelve nations. 

Same: Nation's performance not significantly different from the average at that grade for the twelve nations. 

Below: Nation's performance lower than the average at that grade for the twelve nations. 

2. International average is the average of the national figures for the twelve nations. 

3. Based on standing relative to the international average in third grade. 

4. Based on standing relative to the international average in fourth or fifth grade, depending upon the system in 
place in each state/territory (Australia) or age beginning primary school (New Zealand). 



NOTE: Nations not meeting international sampling and other guidelines in the final year of secondary school 
assessment are shown In parentheses. See Appendix I for details for each country. 

SOURCES: Mullis et al. (1998). Mothemot/cs ond Science Achievement in the FinalYear of Secondary School. Table 2.2. 
Chestnut Hill, MA: Boston College; and Martin et al. ( 1 997). Science Achievement in the Primary School Years. Table I . I . 
Chestnut Hill, MA: Boston College. 
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Table A5.6 

Achievement in Science General Knowledge by Gender for Students in 
Their Final Year of Secondary School 



NATION * 


MALES 


FEMALES 


difference’ 

(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


(CYPRUS) 


459 


(5.8) 


439 


(3.0) 


20 


(6.5) 


(UNITED STATES) 


492 


(4.5) 


469 


(3.9) 


23 


(5.9) 


NEW ZEALAND 


543 


(7.1) 


515 


(5.2) 


28 


(8.8) 


HUNGARY 


484 


(4.2) 


455 


(4.3) 


29 


(6.0) 


(LITHUANIA) 


481 


(6.4) 


450 


(7.3) 


31 


(9.7) 


(CANADA) 


55D 


(3.6) 


518 


(3.8) 


32 


(5.2) 


(SOUTH AFRICA) 


367 


(11.5) 


333 


(13.0) 


34 


(17.4) 


(AUSTRALIA) 


547 


(11.5) 


513 


(9.4) 


34 


(14.8) 


(GERMANY) 


514 


(7.9) 


478 


(8.5) 


35 


(11.6) 


(ITALY) 


495 


(6.7) 


458 


(5.6) 


37 


(8.8) 


(FRANCE) 


508 


(6.7) 


468 


(4.8) 


39 


(8.3) 


SWITZERLAND 


540 


(6.1) 


500 


(7.8) 


40 


(9.9) 


(DENMARK) 


532 


(5.4) 


490 


(4.1) 


41 


(6.8) 


(ICELAND) 


572 


(2.7) 


530 


(2.1) 


41 


(3.4) 


(SLOVENIA) 


541 


(12.7) 


494 


(6.4) 


47 


(14.3) 


(RUSSIAN FEDERATION) 


510 


(5.7) 


463 


(6.7) 


47 


(8.8) 


(NETHERLANDS) 


582 


(5.7) 


532 


(6.2) 


48 


(8.4) 


SWEDEN 


585 


(5.9) 


534 


(3.5) 


50 


(6.8) 


CZECH REPUBLIC 


512 


(8.8) 


460 


(11.0) 


51 


(14.0) 


(AUSTRIA) 


554 


(8.7) 


501 


(5.8) 


53 


(10.4) 


(NORWAY) 


574 


(5.1) 


513 


(4.5) 


61 


(6.8) 


INTERNATIONAL AVERAGE 


521 


(1.6) 


482 


(1.4) 


39 


(2.1) 



GENDER DIFFERENCE 
100 75 50 25 0 25 50 75 100 



Females 

Score 

Higher 



Males 

Score 

Higher 



100 75 50 25 0 25 50 75 100 



■ Gender differences iMthin country significant 
□ Gender differences wthin country not significant 



1. Difference is calculated by subtracting average females’ score from average males’ score, based on 
unrounded averages. 

2. Nations ordered based on size of difference between males’ and females’ scores, from lowest to highest. 

NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix 1 for 
details for each country. 

International average is the average of the national figures. 

“S.E.” is standard error. 

SOURCE: Mullis et al. (1 998). Mathematics and Science Achievement in the Final Year of Secondary School. 
Table 2.5. Chestnut Hill, MA: Boston College. 
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Table A5.7 

Advanced Mathematics and Advanced Science Students As a Proportion of 
Age Cohort and Performance on Advanced Mathematics and on Physics 
Assessments Relative to the United States 



ADVANCED MATHEMATICS 


ADVANCED SCIENCE/PHYSICS 


NATION AND 


PERCENTAGE OF 


NATION AND 


PERCENTAGE OF 


PERFORMANCE 


AGE COHORT 


PERFORMANCE 


AGE COHORT 


RELATIVE TO THE U.S. 


REPRESENTED 


RELATIVE TO THE U.S. 


REPRESENTED 


PERFORMED ABOVE THE U.S. 


(AUSTRALIA) 


16 


(AUSTRALIA) 


13 


CANADA 


16 


(CANADA) 


14 


(CYPRUS) 


9 


(CYPRUS) 


9 


(DENMARK) 


21 


CZECH REPUBLIC 


11 


FRANCE 


20 


(DENMARK) 


3 


GREECE 


10 


FRANCE 


20 


(LITHUANIA) 


3 


(GERMANY) 


8 


(RUSSIAN FEDERATION) 


2 


GREECE 


10 


(SLOVENIA) 


75 


(LATVIA) 


3 


SWEDEN 


16 


NORWAY 


8 


SWITZERLAND 


14 


(RUSSIAN FEDERATION) 


2 






(SLOVENIA) 


39 






SWEDEN 


16 






SWITZERLAND 


14 


AVERAGE 


18 




12 


PERFORMED SAME AS THE U.S. 


(AUSTRIA) 


33 


(AUSTRIA) 


33 


CZECH REPUBLIC 


11 






(GERMANY) 


26 






(ITALY) 


14 






AVERAGE 


21 




33 


(UNITED STATES) 


14 


(UNITED STATES) 


14 


INTERNATIONAL 








AVERAGE 


19 




14 



NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

International average is the average of the national figures. 

SOURCE: Mullls et. a!. (1998). Mathematia and Science Achievement in the Final Year of Secondary School. Figures 5.1 
and 8. 1, Tables 5.1 and 8.1. Chestnut Hill, MA: Boston College. 
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Table A5.8 

Gender Differences in Advanced Mathematics Achievement for 
Students In Their Final Year of Secondary School 
Having Taken Advanced Mathematics 





MALES 


FEMALES 


DIFFERENCE^ 






GENDER DIFFERENCE 


NATION ^ 


AVERAGE 


(S.E.) 


AVERAGE 


(S£.) 




(S£.) 


100 


75 50 


25 ( 


) 25 


50 75 


GREECE 


516 


(6.6) 


505 


(10.2) 


11 


(12.1) 












□ 










(AUSTRALIA) 


531 


(11.4) 


517 


(15.1) 


14 


(189) 






















(CYPRUS) 


524 


(4.4) 


509 


(6.4) 


15 


(7.8) 






Females 

Score 






Z3 




Males 

Score 


(DENMARK) 


529 


(4.4) 


510 


(4.6) 


19 


(6.3) 






Higher 










Higher 


(SLOVENIA) 


484 


(11.5) 


464 


(11.0) 


20 


(15.9) 






















SWEDEN 


519 


(5.9) 


496 


(5.2) 


23 


(7.9) 






















FRANCE 


567 


(5.1) 


543 


(5.1) 


23 


(7.2) 






















(ITALY) 


484 


(10.6) 


460 


(14.1) 


24 


(17.7) 






















(UNITED STATES) 


457 


(7.8) 


426 


(7.1) 


31 


(10.5) 














































(GERMANY) 


484 


(6.5) 


452 


(6.6) 


32 


(9.2) 












































CANADA 


528 


(6.4) 


489 


(4.4) 


39 


(7.7) 












































(LITHUANIA) 


542 


(3.7) 


490 


(5.6) 


51 


(6.7) 






































(RUSSIAN FEDERATION) 


568 


(9.7) 


515 


(10.2) 


53 


(14.1) 










































SWITZERLAND 

f Al lOTDIAt 


559 


(5.6) 


503 


(5.7) 

fSl 


56 


(8.0) 




















>ioc 


At\C. 


Qf\ 




















vAUoIKIA) 


4oo 

tiOA 


(7.3) 


4UD 


(H.b) 


OU 






















CZECH REPUBLIC 


0^4 


(13.0) 


4JZ 


(8.9) 




(lo.r) 






















INTERNATIONAL AVERAGE 


519 


(2.0) 


482 


(2.2) 


37 


(2.9) 

















































100 75 50 25 0 25 50 75 100 



' ■ Gender differences wthin country significant 
Q Gender differences wthin country not significant 



1, Difference is calculated by subtracting average females' score from average males’ score, based on 
unrounded averages. 

2. Nations ordered based on size of difference between males' and females' scores, from lowest to highest. 

NOTES 

Nations not meeting International sampling and other guidelines are shown in parentheses. See Appendix 1 
for details for each country. 

International average is the average of the national figures. 

“S.E.” is standard error, 

SOURCE: Mu His et al, (1 998). Mathematics and Science Achievement in the Final Year of Secondary 
School. Table 5.4. Chestnut Hill, MA: Boston College, 
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Table A5.9 

Achievement in Advanced Mathematics Content Areas By Gender for 
Students Having Taken Advanced Mathematics 





ADVANCED MATHEMATICS CONTENT AREAS 


NATION 


NUMBERS & EQUATIONS 
(17 ITEMS) 


CALCULUS 
(15 ITEMS) 


GEOMETRY 
(23 ITEMS) 




FEMALES 


MALES 


FEMALES 


MALES 


FEMALES 


MALES 




AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


(AUSTRALIA) 


511 


(11.2) 




523 


(9.9) 


525 


(12.2) 




533 


(13.6) 


485 


(13.8) 




505 


(14.1) 


(AUSTRIA) 


385 


(9.3) 


A 


455 


(6.2) 


412 


(7.3) 


A 


486 


(6.9) 


433 


(9.6) 


A 


509 


(7.7) 


CANADA 


496 


(4.5) 


A 


526 


(5.6) 


484 


(4.9) 


A 


521 


(5.5) 


482 


(4.6) 


A 


516 


(5.3) 


(CYPRUS) 


497 


(7.0) 


A 


518 


(6.5) 


562 


(8.0) 




559 


(5.0) 


512 


(8.5) 




520 


(5.2) 


CZECH REPUBLIC 


427 


(10.5) 


A 


510 


(11.3) 


417 


(8.3) 


A 


488 


(11.0) 


461 


(7.2) 


A 


543 


(12.1) 


(DENMARK) 


498 


(3.5) 




507 


(3.6) 


491 


(5.4) 


A 


517 


(4.3) 


519 


(4.0) 


A 


531 


(4.2) 


FRANCE 


544 


(3.9) 




551 


(5.4) 


544 


(4.1) 


A 


569 


(4.3) 


529 


(4.8) 


A 


555 


(5.7) 


(GERMANY) 


446 


(5.1) 


A 


475 


(6.2) 


442 


(5.2) 


A 


471 


(5.6) 


480 


(5.6) 


A 


498 


(7.0) 


GREECE 


537 


(10.4) 




540 


(9.1) 


536 


(12.0) 




540 


(8.2) 


485 


(15.4) 




505 


(7.5) 


(ITALY) 


441 


(14.1) 




472 


(10.6) 


521 


(13.5) 




520 


(11.4) 


472 


(14.5) 




485 


(10.4) 


(LITHUANIA) 


526 


(5.4) 


A 


568 


(3.0) 


478 


(4.8) 


A 


518 


(4.3) 


491 


(5.8) 


A 


539 


(3.6) 


(RUSSIAN FEDERATION) 


533 


(9.8) 


A 


576 


(9.6) 


512 


(10.9) 


A 


560 


(8.9) 


525 


(10.5) 


A 


570 


(8.9) 


(SLOVENIA) 


480 


(10.8) 




503 


(13.0) 


463 


(7.9) 




479 


(8.2) 


469 


(8.9) 




482 


(9.6) 


SWEDEN 


511 


(5.6) 


A 


529 


(6.4) 


472 


(4.9) 




484 


(6.0) 


476 


(5.1) 


A 


500 


(5.5) 


SWITZERLAND 


488 


(5.7) 


A 


536 


(5.7) 


486 


(6.2) 


A 


536 


(6.8) 


522 


(5.9) 


A 


569 


(3.8) 


(UNITED STATES) 


447 


(6.9) 


A 


470 


(6.1) 


439 


(6.1) 


A 


460 


(5.3) 


408 


(7.0) 


A 


439 


(5.8) 


INTERNATIONAL AVERAGE 


485 


(2.1) 


A 


516 


(2.0) 


487 


(2.0) 


A 


515 


(1.9) 


484 


(2.2) 


A 


517 


(2.0) 



A = Males’ score is significantly higher than females’ score. 



NOTES: 

Nations not meeting International sampling and other guidelines are shown in parentheses. See Appendix 1 for 
details for each country. 

International average is the average of the national figures. 

“S.E.” is standard error. 

SOURCE: Mullis et al. (1 998). Mathematics and Science Achievement in the Final Year of Secondary School. 
Table 6.2. Chestnut Hill, MA: Boston College. 



Table A5.10 

Gender Differences in Physics Achievement for Students In Their Final 
Year of Secondary School Having Taken Advanced Science 



NATION * 


MALES 


FEMALES 


DIFFERENCE^ 

(S£.) 


AVERAGE 


(S£.) 


AVERAGE 


(S.E.) 


FRANCE 


478 


(4.2) 


450 


(5.6) 


28 


(7.0) 


GREECE 


495 


(6.1) 


468 


(8.1) 


28 


(10.1) 


(UNITED STATES) 


439 


(4.3) 


405 


(3.1) 


33 


(5.3) 


(CYPRUS) 


509 


(8.9) 


470 


(7.1) 


40 


(11.4) 


(AUSTRALIA) 


532 


(6.7) 


490 


(8.4) 


42 


(10.8) 


(DENMARK) 


542 


(5.2) 


500 


(8.1) 


42 


(9.6) 


(LATVIA) 


509 


(19.0) 


467 


(22.6) 


42 


(29.5) 


(CANADA) 


506 


(6.0) 


459 


(6.3) 


47 


(8.7) 


SWEDEN 


589 


(5.1) 


540 


(5.3) 


49 


(7.4) 


NORWAY 


594 


(6.3) 


544 


(9.3) 


51 


(11.2) 


(GERMANY) 


542 


(14.3) 


479 


(9.1) 


64 


(17.0) 


(RUSSIAN FEDERATION) 


575 


(9.9) 


509 


(15.3) 


66 


(18.2) 


(AUSTRIA) 


479 


(8.1) 


408 


(7.4) 


71 


(11.0) 


CZECH REPUBLIC 


503 


(8.8) 


419 


(3.9) 


83 


(9.7) 


SWITZERLAND 


529 


(5.2) 


446 


(3.6) 


83 


(6.3) 


(SLOVENIA) 


546 


(16.3) 


455 


(18.7) 


91 


(24.8) 


INTERNATIONAL AVERAGE 


523 


(2.4) 


469 


(2.6) 


54 


(3.5) 



GENDER DIFFERENCE 
100 75 50 25 0 25 50 75 100 



Female* 

Score 

Higher 




100 75 50 25 0 25 50 75 100 



■ Gender differences within country significant 
□ Gender differences within country not significant 



1. Difference is calculated by subtracting average females' score from average males' score, based on 
unrounded averages. 

2. Nations ordered based on size of difference between males' and females' scores, from lowest to highest. 

NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix 1 
for details for each country. 

International average is the average of the national figures. 

“S.E.” is standard error. 



SOURCE: Mullis et al. (1998). Mathematics and Science Achievement in the Final Year of Secondary 
School. Table 8.4. Chestnut Hill, MA: Boston College. 
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Table A5.11 

Achievement in Physics Content Areas by Gender for Advanced 
Science Students 





PHYSICS CONTENT AREAS 


NATION 


MECHANICS 
(17 ITEMS) 


ELECTRICITY AND MAGNETISM 
(15 ITEMS) 


HEAT 
(23 ITEMS) 




FEMALES 


MALES 


FEMALES 


MALES 


FEMALES 


MALES 




AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


VERAG 


(S.E.) 


VERAG 


(S.E.) 


(AUSTRALIA) 


474 


(6.8) 


A 


524 


(7.8) 


488 


(8.3) 


A 


525 


(6.7) 


503 


(6.2) 


A 


524 


(5.0) 


(AUSTRIA) 


399 


(6.3) 


A 


459 


(6.6) 


409 


(6.9) 


A 


468 


(9,1) 


420 


(6.8) 


A 


485 


(8.0) 


(CANADA) 


440 


(5.7) 


A 


499 


(6.6) 


468 


(6.5) 


A 


497 


(6.2) 


492 


(8.1) 


A 


520 


(5.2) 


(CYPRUS) 


496 


(10.3) 


A 


551 


(9.6) 


494 


(7.4) 




507 


(8.5) 


461 


(11.2) 




484 


(9.8) 


CZECH REPUBLIC 


440 


(4.8) 


A 


514 


(8.4) 


443 


(3.3) 


A 


501 


(8.7) 


472 


(4.5) 


A 


513 


(6.6) 


(DENMARK) 


483 


(10.2) 


A 


540 


(5.5) 


498 


(7.8) 




515 


(4.5) 


487 


(9.6) 


A 


517 


(5.3) 


FRANCE 


437 


(5.5) 


A 


470 


(5.6) 


491 


(5.2) 




495 


(4.2) 


487 


(5.7) 




496 


(4.0) 


(GERMANY) 


453 


(10.6) 


A 


515 


(9.6) 


491 


(7.7) 


A 


522 


(12.1) 


461 


(10.6) 


A 


513 


(6.3) 


GREECE 


489 


(7.2) 


A 


525 


(7.0) 


515 


(11.0) 




522 


(6.5) 


460 


(10.5) 


A 


490 


(8.1) 


(LATVIA) 


468 


(19.8) 




509 


(15,2) 


474 


(18.4) 




496 


(16.8) 


484 


(23.4) 




523 


(17.8) 


NORWAY 


523 


(9.0) 


A 


589 


(6.1) 


549 


(10.0) 




570 


(6.2) 


511 


(7.0) 


A 


545 


(4.4) 


(RUSSIAN FEDERATION) 


507 


(12.3) 


A 


563 


(7.4) 


519 


(12.9) 


A- 


575 


(7.7) 


501 


(14.8) 


A 


555 


(7.5) 


(SLOVENIA) 


487 


(21.7) 


A 


576 


(17,5) 


470 


(13.8) 


A 


522 


(16.6) 


470 


(18.7) 


A 


538 


(13.1) 


SWEDEN 


517 


(4.4) 


A 


586 


(4.6) 


551 


(4.7) 


A 


579 


(4.8) 


507 


(5.3) 


.A 


529 


(5.8) 


SWITZERLAND 


444 


(3.5) 


A 


519 


(5.3) 


452 


(4.5) 


A 


507 


(7.1) 


480 


(5.7) 


A 


538 


(4.3) 


(UNITED STATES) 


393 


(2.8) 


A 


446 


(3.5) 


409 


(3.6) 


A 


430 


(3.5) 


474 


(2.7) 




480 


(4.2) 


INTERNATIONAL AVERAGE 


m 


(2.6) 


A 


524 


(2.2) 


483 


(2.3) 


A 


514 


(2.2) 


479 


(2.7) 


A 


516 


(2.0) 



A = Males’ score is significantly higher than females’ score. 





118 



Table A5.1 1 (continued) 

Achievement in Physics Content Areas by Gender for Advanced 
Science Students 



PHYSICS CONTENT AREAS 



NATION 


WAVE PHENOMENA 
(lOFTEMS) 


MODERN PHYSICS 
(14 ITEMS) 




FEMALES 


MALES 


FEMALES 


MALES 




AVERAGE 


(S.E.) 


AVERAGE 


(S.E.) 


AVERAGE 


(S£.) 


AVERAGE 


(S.E.) 


(AUSTRALIA) 


498 


(7.2) 


▲ 


529 


(9.0) 


497 


(7.8) 


▲ 


533 


(6.7) 


(AUSTRIA) 


444 


(9.7) 


▲ 


506 


(7.3) 


465 


(6.1) 


▲ 


505 


(9.9) 


(CANADA) 


476 


(6.4) 


▲ 


497 


(4.3) 


471 


(5.1) 


▲ 


513 


(6.0) 


(CYPRUS) 


486 


(8.4) 


▲ 


519 


(10.4) 


411 


(9.9) 


▲ 


450 


(7.7) 


CZECH REPUBLIC 


419 


(4.9) 


▲ 


491 


(7.2) 


425 


(4.6) 


▲ 


498 


(6.9) 


(DENMARK) 


493 


(10.0) 


▲ 


547 


(6.3) 


529 


(7.4) 




546 


(6.0) 


FRANCE 


448 


(4.6) 


▲ 


475 


(5.6) 


457 


(4.1) 


▲ 


485 


(4.3) 


(GERMANY) 


485 


(10.1) 


▲ 


551 


(12.7) 


508 


(13.5) 


▲ 


561 


(15.3) 


GREECE 


444 


(7.2) 




457 


(7.4) 


426 


(5.7) 


▲ 


456 


(6.4) 


(LATVIA) 


480 


(16.2) 




515 


(17.3) 


470 


(20.8) 




505 


(16.6) 


NORWAY 


519 


(10.2) 


▲ 


575 


(4.9) 


549 


(9.9) 


▲ 


585 


(5.0) 


(RUSSIAN FEDERATION) 


487 


(12.4) 


▲ 


539 


(7.9) 


520 


(13.9) 


▲ 


561 


(7.9) 


(SLOVENIA) 


446 


(13.4) 


▲ 


538 


(11.9) 


458 


(14.1) 


▲ 


528 


(18.7) 


SWEDEN 


528 


(5.9) 


▲ 


576 


(6.1) 


538 


(6.2) 


▲ 


570 


(3.3) 


SWITZERLAND 


460 


(4.4) 


▲ 


533 


(4.8) 


1 457 


(4.4) 


▲ 


519 


(5.8) 


(UNITED STATES) 


442 


(3.0) 


▲ 


460 


(2.6 


1 446 


(2.3 


▲ 


466 


(3.6) 


INTERNATIONAL AVERAGE 


472 


(2.3] 


1 A 


519 


(2.2] 


I 477 


(2.4) 


1 ▲ 


518 





A = Males' score is significantly higher than females’ score. 



nv I 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix for 
details for each country. 

International average Is the average of the national figures. 

“S.E." is standard error. 

SOURCE: Mullis et al. (1 998). Mathematics and Science Achievement in the Final Year of Secondary School. Table 9.2. 
Chestnut Hill, MA: Boston College. 
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Table A5.12 

Extent of Differentiation in Secondary Education and Performance on TIMSS 
General Knowledge Assessments Relative to the United States 



EXTENSIVE DIFFERENTIATION 
WITHIN AND BETWEEN 
SCHOOLS IN PROGRAMS FOR 
STUDENTS WITH DIFFERING 
ABILITIES OR INTERESTS 


DIFFERENTIATION IN LENGTH OF 
SECONDARY EDUCATION 


YES 


NO 


YES 

(SPECIALIZED AND 
MIXED SECONDARY 
SCHOOLS) 


(AUSTRIA) 

CZECH REPUBLIC 

(FRANCE) 

(GERMANY) 

HUNGARY 

(ICELAND) 

(ITALY) 

(LITHUANIA) 
(NETHERLANDS) 
(RUSSIAN FEDERATION) 
(SLOVENIA) 

SWEDEN 

SWITZERLAND 


(CYPRUS) 

(DENMARK) 

(NORWAY) 


NO 

(COMPREHENSIVE 
SECONDARY SCHOOLS) 


(CANADA) 
NEW ZEALAND 


(AUSTRALIA) 

(SOUTH AFRICA) 
(UNITED STATES) 



NOTES: 

detans^for°Ja!T^^ sampling and other guidelines are shown in parentheses. See Appendix I for 

performed above the U.S. in both mathematics and science general knowledge. 

Bold italic. Nations that performed above the U.S. In mathematics general knowledge only. 

/M/fr^ Nations that performed sinriilar to the U.S. in both mathematics and science general knowledge. 

Itohc. Nations that performed below the U.S. In both mathematics and science general knowledge. ^ 

Suntries^*^ Latvia participated only in the physics and/or advanced mathematics assessments. For these 

Greece: Specialized/mixed schools and varying lengths of secondary schooling. 

Latvia: Specialized/mixed schools and varying lengths of secondary schooling. 



SOURCE: Mullis et al. (1998). Mothemot/cs and 
Chestnut Hill, MA: Boston College. 



Science Achievement in the Find Year of Secondary School. Appendix A. 
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TABLE A5.13 

Average Age of Students Assessed and Grades Included in 
General Knowledge Assessments Compared to Performance on Mathematics General 
Knowledge Assessment Relative to the United States 



NATION AND 
PERFORMANCE 


AVERAGE AGE 
OF STUDENTS 
PARTICIPATING IN 
GENERAL 
KNOWLEDGE 




END OF SECONDARY GRADES 


RELATIVE TO THE 
U.S. IN 

MATHEMATICS 


ASSESSED IN GENERAL KNOWLEDGE 
ASSESSMENTS 


GENERAL 

KNOWLEDGE 


ASSESSMENTS 


10 


11 


12 


13 


14 


RANGE 


PERFORMED ABOVE THE U.S. 


(AUSTRALIA) 


17.7 






X 






12 


(AUSTRIA) 


19.1 


X 


X 


X 


X 


X 


10-14 


(CANADA) 


18.6 






X 


X 


X 


12-14 


(DENMARK) 


19.1 






X 






12 


(FRANCE) 


18.8 




X 


X 


X 




11-13 


(GERMANY) 


19.5 






X 


X 




12-13 


HUNGARY 


17.5 


X 




X 






10,12 


(ICELAND) 


21.2 






X 


X 


X 


12-14 


(NETHERANDS) 


18.5 




X 


X 






11-12 


NEW ZEAAND 


17.6 




X 


X 






11-12 


(NORWAY) 


19.5 






X 






12 


(SLOVENIA) 


18.8 




X 


X 






11-12 


SWEDEN 


18.9 




X 


X 






11-12 


SWITZERAND 


19.8 




X 


X 


X 




11-13 


AVERAGE 


18.9 














PERFORMED SAME AS THE U.S. 


CZECH REPUBLIC 


17.8 


X 


X 


X 


X 




10-13 


(ITALY) 


18.7 




X 


X 


X 




11-13 


(LITHUANIA) 


18.1 






X 






12 


(RUSSIAN FEDERATION) 


16.9 




X 








11 


PERFORMED BELOW THE U.S. 


(CYPRUS) 


17.7 






X 






12 


(SOUTH AFRICA) 


20.1 






X 






12 


AVERAGE 

(SAME AND BELOW) 


18.2 














(UNITED STATES) 


18.1 






X 






12 


INTERNATIONAL 

AVERAGE 


18.7 















NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

International average is the average of the national figures. 

SOURCE: Mullis et al. (1998). Mathema^cs and Science Achievement /n the Final Year of Secondary School. Table l.l. 
Figure 2. 1 , and Appendix A. Chestnut Hill, MA Boston College. 
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TABLE AS. 14 

Secondary Enrollment and Completion Compared to the United States 



NATION AND 
PERFORMANCE 
RELATIVE TO THE 
U.S. IN 

MATHEMATICS 

GENERAL 

KNOWLEDGE 


PERCENTAGE 

IN 

SECONDARY 

SCHOOL 


PERCENTAGE 
25-34- YEAR-OLDS 
COMPLETING 
SECONDARY 
EDUCATION 


PERCENTAGE ENROLLED 
IN SECONDARY EDUCATION 
BY AGE 


17 


18 


19 


20 


PERFORMED ABOVE THE U.5. 






(AUSTRALIA) 


84 


57 


77 


32 


20 


17 


(AUSTRIA) 


107 


81 


88 


56 


22 


8 


(CANADA) 


88 


84 


69 


34 


10 





(DENMARK) 


114 


69 


82 


71 


52 


31 


(FRANCE) 


106 


86 


91 


60 


34 


15 


(GERMANY) 


101 


89 


93 


82 


57 


31 


HUNGARY 


81 


— 


71 


39 


17 


11 


(ICELAND) 


103 


— 


77 


65 


63 


33 


(NETHERLANDS) 


93 


70 


91 


69 


47 


32 


NEW ZEALAND 


104 


64 


74 


33 


17 


13 


(NORWAY) 


116 


88 


90 


83 


33 


19 


(SLOVENIA) 


85 


— 











_ 


SWEDEN 


99 


88 


96 


87 


24 


12 


SWITZERLAND 


91 


88 


82 


75 


52 


23 


AVERAGE 


98 


79 


83 


60 


34 


20 


PERFORMED SAME AS THE U.S. 






CZECH REPUBLIC 


86 


91 


72 


30 


6 


3 


(ITALY) 


81 


49 











_ 


(LITHUANIA) 


78 


— 











_ 


(RUSSIAN FEDERATION) 


88 


— 


— 


- 


- 


- 


PERFORMED BELOW THE U.S. 






(CYPRUS) 


95 





_ 








(SOUTH AFRICA) 


77 


— 


- 


- 


- 


- 


AVERAGE 


84 












(SAME AND BELOW) 














(UNITED STATES) 


97 


87 


75 


22 


4 


2 


INTERNATIONAL 


94 


78 


82 


56 


31 


18 


AVERAGE 















— Data not available. 



Percentage in secondary school represents gross enrollment of all ages at the secondary level as a percentage of 
school-age children as defined by each country. This may be reported in excess of 100% if some pupils are 
younger or older than the country’s standard range of secondary school age. 

NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

International average is the average of the national figures. 

Percentage in secondary school, 1 995; Percentage 25-34 year olds completing secondary education from National Labor 
Force surveys. 1995 or 1996; Percentage enrolled in secondary education by age refers to school year 1994/95 (except 
for Austria v/here data is for 1992/93 school year). 



al. (1998). Mathtmatics and Science Achievement in the Final Year of Secondary School, Table 4 and 
/ ^ston College; and Organisation for Economic Cooperation and Development 

(1997). Education at a Glance: OECD Indicators. Tables A2.2a and C3.3. Paris: OECD. 
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TABLE AS. 15 

Centralization Of Decision-Making About Curriculum Syllabi And 
Performance On Mathematics And Science General Knowledge Assessments 
Relative To The United States 



extent of centralization 


nation 




(AUSTRIA) 

(CYPRUS) 

CZECH REPUBLIC 

(DENMARK) 


nationally centrauzed 


(FRANCE) 

(ITALY) 

(LITHUANIA) 

NEW ZEALAND 
(NORWAY) 
(SLOVENIA) 
(SOUTH AFRICA) 
SWEDEN 




(CANADA) 


regionally centrauzed 


(GERMANY) 

SWITZERLAND 




(AUSTRAUA) 

HUNGARY 


NOT CENTRAUZED 


(ICELAND) 

(NETHERLANDS) 

(RUSSIAN FEDERATION) 
(UNITED STATES) 



NOTES: 

Countries are "Nationally Centralized" regarding curriculum if the highest level of decision-making authority within 
the education system (e.g., ministry of education) has exclusive responsibility for or gives final approval of the syllabi 
for courses of study. If curriculum syllabi are determined at the regional level (e.g., state, province, territory), a coun- 
try is "Regionally Centralized" If syllabi for courses of study are not determined nationally or regionally, a country is 
“Not Centralized" 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

Bold: Nations that performed above the U.S. in both mathematics and science general knowledge. 

Bold Italic: Nations that performed above the U.S. In mathematics general knowledge only. 

Regular: Nations that performed similar to the U.S. in both mathematics and science general knowledge. 

Italic Nations that performed below the U.S. in both mathematics and science general knowledge. 

SOURCE: Mullis et al. ( 1 998). Mathematics and Science Achievement in the Final Year of Secondary School. Figure I . 
Chestnut Hill, MA: Boston College. 
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TABLE AS. 16 

Gross National Product Per Capita and Public Expenditure on Elementary and 
Secondary Education of TIMSS Nations Compared to Performance on The 
Mathematics General Knowledge Assessment Relative to the United States 



NATION AND 
PERFORMANCE 
RELATIVE TO THE U.S. 
IN MATHEMATICS 
GENERAL 
KNOWLEDGE 


GNP PER CAPITA 
(U.S. $) 


PUBLIC EXPENDITURE 
ON ELEMENTARY/ 
SECONDARY 
EDUCATION 
AS PERCENT OF GNP 


PUBLIC EXPENDITURE 
ON ELEMENTARY/ 
SECONDARY 
EDUCATION 
PER CAPITA (U.S. $) 


PERFORMED ABOVE THE U.S. 


(AUSTRALIA) 


$17,980 


3.69 


$663 


(AUSTRIA) 


24950 


424 


1.058 


(CANADA) 


19,570 


4.62 


904 


(DENMARK) 


28,110 


4.80 


1,349 


(FRANCE) 


23,470 


3.61 


847 


(GERMANY) 


25,580 


2.43 


622 


HUNGARY 


3,840 


4.31 


166 


(ICELAND) 


24,590 


4.77 


1,173 


(NETHERLANDS) 


21,970 


3.30 


725 


NEW ZEALAND 


13,190 


3,15 


415 


(NORWAY) 


26,480 


5.26 


1.393 


(SLOVENIA) 


7,140 


4.20 


300 


SWEDEN 


23,630 


4.92 


1,163 


SWITZERLAND 


37,180 


3.72 


1,383 


AVERAGE 


21,263 


4.07 


869 


PERFORMED SAME AS THE U.S. 


CZECH REPUBLIC 


3,210 


3.75 


120 


(ITALY) 


19,270 


2.89 


557 


(LITHUANIA) 


1,350 


2.18 


29 


(RUSSIAN FEDERATION) 


2,650 


- 


— 


PERFORMED BELOW THE U.S. 


(CYPRUS) 


10,380 


3.60 


374 


(SOUTH AFRICA) 


3,010 


5.12 


154 


AVERAGE 








(SAME AND BELOW) 


6.645 


3.51 


247 


(UNITED STATES) 


25,860 


4.02 


1,040 


INTERNATIONAL 

AVERAGE 


17,305 


3.93 


722 



— Data not available, 

NOTES; 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

International average is the average of the national figures. 

GNP per capita and public expenditure figures based on estimates for 1994 at current market prices in U.S. dollars, 
except in Cyprus where GNP per capita figure is for 1993. 

SOURCE: Mullis et al. (1998). Mothemot/cs and Science Achievement in the Final Year of Secondary School. Table 5 and 
Figure 2.1, Chestnut Hill, MA: Boston College. 
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Table A5.17 

Average Age of Participants in TIMSS Eighth-Grade Mathematics Assessment and 
Final Year of Secondary School Mathematics General Knowledge Assessment 
And Nations’ Relative Standing in Achievement in The Two Assessments 



NATION’S STANDING 
RELATIVE TO THE 
INTERNATIONAL 
AVERAGE IN EIGHTH 
GRADE COMPARED TO 
FINAL YEAR OF 
SECONDARY SCHOOL 


NATION 


AVERAGE AGE OF 
PARTICIPANTS IN 
ASSESSMENT 


DIFFERENCE IN 
AVERAGE AGE OF 
PARTICIPANTS IN THE 
TWO ASSESSMENTS' 


EIGHTH 

GRADE 


FINAL YEAR 
OF 

SECONDARY 

SCHOOL 




(DENMARK) 


13.92 


19.1 


5.2 


HIGHER IN FINAL 


(ICELAND) 


13.6 


21.2 


7.6 


year of 


NEW ZEALAND 


14,03 


17.6 


3.6 


SECONDARY SCHOOL 


(NORWAY) 


13.92 


19.5 


5.6 




SWEDEN 


13.92 


18.9 


5.0 


AVERAGE 


13.9 


19.3 


5.4 




(AUSTRIA) 


14.3 


19.1 


5.8 




(CANADA) 


14.1 


18.6 


4.5 




(CYPRUS) 


13.7 


17.7 


4.0 




(FRANCE) 


14.3 


18.8 


4.5 


SAME IN BOTH 


(GERMANY) 


14.8 


19.5 


4.7 




(LITHUANIA) 


14.3 


18.1 


3.8 




(NETHERLANDS) 


14.3 


18.5 


4.2 




(SOUTH AFRICA) 


15.4 


20.1 


4.7 




SWITZERLAND 


14.2^ 


19.8 


5.6 


AVERAGE 


14.4 


18.9 


4.6 




(AUSTRALIA) 


14.23 


17.7 


3.5 


LOWER IN FINAL 


CZECH REPUBLIC 


14.4 


17.8 


3.4 


YEAR OF 


HUNGARY 


14.3 


17.5 


3.2 


SECONDARY SCHOOL 


(RUSSIAN FEDERATION) 


14.0'’ 


16.9 


2.9 




(SLOVENIA) 


14.8 


18.8 


4.0 




(UNITED STATES) 


14.2 


18.1 


3.9 


AVERAGE 


14.3 


17.8 


3.5 


INTERNATIONAL AVERAGE 


14.2 


18.7 


4.4 



I . Difference in average ages is calculated by subtracting the average age of the participants in the eighth grade mathematics 
assessment from the average age of the participants in the final year of secondary school mathematics general knowledge 
assessment 



2. Based on average age of participants in the seventh grade. 

3. Based on average age of participants in eighth or ninth grade, depending upon the system in place in each state/territory 
(Australia) or age beginning primary school (New Zealand). 

4. Based on average age in seventh or eighth grade, depending upon the system in place in each canton (Switzerland) or age 
beginning secondary school (Russian Federation). 

NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for details for each 
country. 

International average is the average of national figures. 

SOURCES: Mullis et al. ( 1 998V Mothemot/cs and Science Achievement in the Final Year of Secondary School. Table l.l and Figure 2.3. 
Chestnut Hill, MA: Boston College: Mullis et al. (1996). Mathemot/cs Achievement in the Middle School Years. Table l.l. 
Chestnut Hill, MA: Boston College. 
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Table A5.18 

Mathematics and Science Coursetaking and Change in Standing Relative to the 
International Average Between Eighth Grade and Final Year of Secondary School 



COMPARISON TO THE 
UNITED STATES ON 
COURSETAKING 


PERCENTAGE OF STUDENTS 
CURRENTLY TAKING 
MATHEMATICS 


PERCENTAGE OF STUDENTS 
CURRENTLY TAKING 
SCIENCE 


NATION ABOVE 
U.S. 


(AUSTRALIA) 

(CYPRUS) 

CZECH REPUBLIC 
(DENMARK) 

(FRANCE) 

HUNGARY 

(LITHUANIA) 

(RUSSIAN FEDERATION) 
(SLOVENIA) 


(AUSTRALIA) 

(AUSTRIA) 

(CYPRUS) 

(FRANCE) 

HUNGARY 

(ICELAND) 

(LITHUANIA) 

NEW ZEALAND 
(RUSSIAN FEDERATION) 
(SLOVENIA) 

(SOUTH AFRICA) 


NATION SAME AS 
U.S. 


(AUSTRIA) 
(ICELAND) 
(NETHERLANDS) 
NEW ZEALAND 
(NORWAY) 
(SOUTH AFRICA) 
SWEDEN 
SWITZERLAND ■ 


(CANADA) 

(NETHERANDS) 

SWITZERLAND 


NATION BELOW 
U.S. 


(CANADA) 


CZECH REPUBLIC 

(DENMARK) 

(NORWAY) 

SWEDEN 


DATA NOT AVAILABLE 


(GERMANY) 


(GERMANY) 


(UNITED STATES) 


66%^ 


53%^ 


INTERNATIONAL AVERAGE 


79% 


67% 



★ U.S. average is significantly different from the international average. 



NOTES: 

Nations not meeting international sampling and other guidelines for the end of secondary assessment are shown In 

parentheses. See Appendix I for details for each country. 

Bold: Nations that have a higher relative standing compared to the international average In eighth grade than at 

the end of secondary school in that subject. 

Regular Nations in which the relative standing compared to the international average is similar in eighth grade and 
at the end of secondary school in that subject. 

Italic Nations that have a lower relative standing compared to the international average in eighth grade than at 
the end of secondary school in that subject 

International average is the average of the national figures. 

SOURCE: Mullls et al. (1998). Mothemot/cs and Science Achievement in the Final Year of Secondary School. Tables 4.2, 

4.4, and Figures 2.3 and 2.4. Chestnut Hill, MA: Boston College. 
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Table A5.19 

Average Age of Participants in TIMSS Eighth-Grade Science Assessment and 
Final Year of Secondary School Science General Knowledge Assessment 
AND Change In Nation’s Standing Relative to the International Average From 
Eighth Grade To Final Year of Secondary School 



CHANGE IN NATION’S 
STANDING RELATIVE TO 
THE INTERNATIONAL 
AVERAGE FROM EIGHTH 
GRADE TO FINAL YEAR 
OF SECONDARY 
SCHOOL 


NATION 


AVERAGE AGE OF 
PARTICIPANTS IN 
ASSESSMENT 


DIFFERENCE IN 
AVERAGE AGE OF 
PARTICIPANTS IN THE 
TWO ASSESSMENTS' 


EIGHTH 

GRADE 


FINAL YEAR 
OF 

SECONDARY 

SCHOOL 




(DENMARK) 


13.92 


19.1 


5.2 


HIGHER IN FINAL 


(FRANCE) 


14.3 


18.8 


4.5 


YEAR OF 


(ICELAND) 


13.6 


21.2 


7.6 


SECONDARY SCHOOL 


NEW ZEAAND 


14.03 


17.6 


3.6 




SWIT2ERAND 


14.2^ 


19.8 


5.6 


AVERAGE 


14.0 


19.3 


5.3 




(AUSTRIA) 


14.3 


19.1 


4.8 




(CANADA) 


14.1 


18.6 


4.5 




(CYPRUS) 


17.7 


17.1 


4.0 


SAME IN BOTH 


(LITHUANIA) 


14.3 


18.1 


3.8 




(NETHERANDS) 


14.3 


18.5 


4.5 




(NORWAY) 


13.92 


19.5 


5.6 




(SOUTH AFRICA) 


15.4 


20.1 


4.7 




SWEDEN 


13.92 


18.9 


5.0 


AVERAGE 


14.2 


18.8 


4.6 




(AUSTRALIA) 


14.23 


17.7 


3.5 




CZECH REPUBLIC 


14.4 


17.8 


3.4 


LOWER IN FINAL 


(GERMANY) 


14.8 


19.5 


4.7 


YEAR OF 


HUNGARY 


14.3 


17.5 


3.2 


SECONDARY SCHOOL 


(RUSSIAN FEDERATION) 


14.0^ 


16.9 


2.9 




(SLOVENIA) 


14.8 


18.8 


4.0 




(UNITED STATES) 


14.2 


18.1 


3.9 


AVERAGE 


14.4 


18.0 


3.7 


INTERNATIONAL AVERAGE 


14.2 


18.7 


4.4 



1 . Difference in average ages is calculated by subtracting the average age of the participants in the eighth grade mathematics 
assessment from the average age of the participants in the final year of secondary school mathematics general knowledge 
assessment 

2. Based on average age of participants in the seventh grade. 

3. Based on average age of participants in eighth or ninth grade, depending upon the system in place in each statc/territory 
(Australia) or age beginning primary school (New Zealand). 

4. Based on average age in seventh or eighth grade, depending upon the system in place in each canton (Switzerland) or age 
beginning secondary school (Russian Federation). 

NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for details for each 

country. 

International average is the average of national figures. 



SOURCES: Mullis et al. (1998). Mrnhematics and Sdence Achievement in the FinalYearaf Secondary School. Table l.l and Figure 2.4. 
Chestnut Hill, MA: Boston College; Mullis et al. (1996). Sdence Achievement in the Middle School Years. Table l.l. Chestnut Hill, MA: 
Boston College. 
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Table A5.20 

Responses to Selected Student Questionnaire Items: 

Responses of Students Participating in Mathematics and Science General 
Knowledge Assessments 



COMPARISON 
TO THE U.S. ON 
THE FACTOR 


PERCENTAGE OF 
STUDENTS 

CURRENTLY TAKING 
MATHEMATIC:S 


PERCENTAGE OF 
STUDENTS CURRENTLY 
TAKING SCIENCE 


AVERAGE HOURS OF 
HOMEWORK 
PER DAY 


PERCENTAGE WHO 
USE A CALCULATOR 
“DAILY” 


NATION 
ABOVE U.S. 
ON THIS 
FACTOR 


(AUSTRALIA) 

(CYPRUS) 

CZECH REPUBLIC 

(DENMARK) 

(FRANCE) 

HUNGARY 

(ITALY) 

(LITHUANIA) 

(RUSSIAN FEDERATION) 
(SLOVENIA) 


(AUSTRALIA) 

(AUSTRIA) 

(CYPRUS) 

(FRANCE)* 

HUNGARY* 

(ICELAND) 

(ITALY) 

(LITHUANIA) 

NEW ZEALAND 
(RUSSIAN FEDERAnON) 
(SLOVENIA) 

(SOUTH AFRICA) 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

(CYPRUS) 

(DENMARK) 

(FRANCE) 

HUNGARY 

(ICELAND) 

(ITALY) 

(LITHUANIA) 

NEW ZEALAND 
(RUSSIAN FEDERATION) 
(SLOVENIA) 

(SOUTH AFRICA) 
SWITZERLAND 


(AUSTRALIA) 

(CANADA) 

(CYPRUS) 

(DENMARK) 

(FRANCE) 

HUNGARY 

(ICELAND) 

(NETHERLANDS) 

NEW ZEALAND 

(SOUTH AFRICA) 


NATION 
SAME AS U.S. 
ON THIS 
FACTOR 


(AUSTRIA) 
(ICELAND) 
(NETHERLANDS) 
NEW ZEALAND 
(NORWAY) 
(SOUTH AFRICA) 
SWEDEN 
SWITZERLAND 


(CANADA) 

(NETHERLANDS) 

SWITZERLAND 


(NETHERLANDS) 

(NORWAY) 

SWEDEN 


(AUSTRIA) 

(ITALY) 

(LITHUANIA) 

(NORWAY) 

(SLOVENIA) 

SWITZERLAND 


NATION 
BELOW U.S. 
ON THIS 
FACTOR 


(CANADA) 


CZECH REPUBLIC 

(DENMARK) 

(NORWAY) 

SWEDEN 


CZECH REPUBLIC 


CZECH REPUBLIC 
(RUSSIAN FEDERATION) 

SWEDEN 


DATA NOT 
AVAILABLE 


(GERMANY) 


(GERMANY)* 


(GERMANY) 


(GERMANY) 


(UNITED STATES) 


66%^ 


53%^ 


T.7 HOURS^ 


52% 


INTERNATIONAL 

AVERAGE 


79% 


67% 


2.6 HOURS 


55% 



Notes for this table can be found at the end of table. 



How to read this table: Columns represent responses to particular questionnaire items. The first three rows 
show how each nation’s students responded in comparison with U.S. students on that item. The style of the font for 
the country names indicates how students in that country performed on the general knowledge assessment relative 
to the U.S. For example, the first column represents student responses to whether they were currently taking math- 
ematics. The first row in the first column lists the 10 countries in which a higher percentage of students than in the 
U.S. reported that they were currently taking mathematics. The second row in the first column lists the 8 nations in 
which a similar percentage of students as the U.S. reported that they were currently taking mathematics. The third 
row in the first column lists the one nation In which a lower percentage of students than in the U.S. reported that 
they were currently taking mathematics. 




Table A5.20— (Continued) 



COMIVkRISON 
TO THI U.S. ON 
TMf KACTOR 


PERCENTAGE WHO 
USED A 

CALCULATOR ON 
THE TIMSS 
MATHEMATICS 
GENERAL 
KNOWLEDGE 
ASSESSMENT 


PERCENTAGE WHO 
USE A COMPUTER AT 
SCHOOL, HOME, OR 
ELSEWHERE 


PERCENTAGE WHO 
LIKE MATHEMATICS 
“A LOT” 


PERCENTAGE WHO 
“LIKE” CHEMISTRY 
OR LIKE IT “A LOT” 


NATION 
ABOVE U.S. 
ON THIS 
FACTOR 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

CZECH REPUBLIC 

(DENMARK) 

(FRANCE) 

(GERMANY) 

HUNGARY 

(NETHERLANDS) 

NEW ZEALAND 

SWEDEN 

SWITZERLAND 


(DENMARK) 

(ICELAND) 


(DENMARK) 

(SOUTH AFRICA) 


(ICELAND) 

(SOUTH AFRICA) 


NATION 
SAME AS U.S. 
ON THIS 
FACTOR 


(CYPRUS) 

(ICELAND) 

(ITALY) 

(NORWAY) 

(SLOVENIA) 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

(NETHERLANDS) 

NEW ZEALAND 

SWEDEN 


(CYPRUS) 

(ICELAND) 

(ITALY) 

SWITZERLAND 


(CANADA) 

(CYPRUS) 

(FRANCE)* 

(ITALY) 

(NORWAY) 

(RUSSIAN FEDERAHON) 

SWEDEN 

SWITZERLAND 


NATION 
BELOW U.S. 
ON THIS 
FACTOR 


(LITHUANIA) 

(RUSSIAN FEDERAHON) 
(SOUTH AFRICA) 


(CYPRUS) 

CZECH REPUBLIC 

(FRANCE) 

HUNGARY 

(ITALY) 

(LITHUANIA) 

(NORWAY) 

(RUSSIAN FEDERATION) 
(SLOVENIA) 

(SOUTH AFRICA) 
SWITZERLAND 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

CZECH REPUBLIC 
(FRANCE) 

HUNGARY 

(LITHUANIA) 

NEW ZEALAND 
(NORWAY) 

(RUSSIAN FEDERATlOrsO 
(SLOVENIA) 

SWEDEN 


(AUSTRALIA) 

(AUSTRIA) 

CZECH REPUBLIC 

(DENMARK) 

HUNGARY* 

(LITHUANIA) 

NEW ZEALAND 
(SLOVENIA) 


DATA NOT 
AVAILABLE 




(GERMANY) 


(GERMANY) 

(NETHERLANDS) 


(GERMANY)* 

(NETHERLANDS) 


(UNITED STATES) 


71%* 


73%* 


21%* 


49%* 


INTERNATIONAL 

AVERAGE 


79% 


57% 


15% 


42% 
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Table A5.20— (Continued) 



COMPARISON 
TO THE U.S. ON 
THE FACTOR 


PERCENTAGE WHO 
“LIKE” EARTH 
SCIENCE OR LIKE IT 
“A LOT” 


PERCENTAGE WHO 
“LIKE” PHYSICS OR 
LIKE IT “A LOT" 


PERCENTAGE WHO 
“LIKE” BIOLOGY OR 
LIKE IT “A LOT” 


PERCENTAGE WHO 
HAD SOMETHING 
STOLEN AT SCHOOL 
IN THE MONTH 
PRIOR TO TIMSS 


NATION 
ABOVE U.S. 
ON THIS 
FACTOR 


(LITHUANIA) 


(SOUTH AFRICA) 


(ICELAND) 

(RUSSIAN FEDERATION) 
(SOUTH AFRICA) 


(SOUTH AFRICA) 


NATION 
SAME AS U.S. 
ON THIS 
FACTOR 


(AUSTRIA) 

(CANADA) 

CZECH REPUBLIC 

(ICELAND) 

(ITALY) 

(RUSSIAN FEDERATION) 

(SLOVENIA) 

(SOUTH AFR(CA) 

SWEDEN 

SWITZERLAND 


(CANADA) 

(CYPRUS) 

(DENMARK) 

(FRANCE)* 

(ICELAND) 

(ITALY) 

(NORWAY) 

(RUSSIAN FBDERATION) 

SWEDEN 

SWITZERLAND 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

(CYPRUS) 

(DENMARK) 

(FRANCE)* 

HUNGARY* 

(ITALY) 

(LITHUANIA) 

NEW ZEALAND 

SWEDEN 

SWIHERLAND 


NEW ZEALAND 


NATION 
BELOW U.S. 
ON THIS 
FACTOR 


(AUSTRALIA) 

(CYPRUS) 

(DENMARK) 

(FRANCE)* 

HUNGARY* 

NEW ZEALAND 

(NORWAY) 


(AUSTRALIA) 

(AUSTRIA) 

CZECH REPUBLIC 

HUNGARY* 

(LITHUANIA) 

NEW ZEALAND 
(SLOVENIA) 


CZECH REPUBLIC 

(NORWAY) 

(SLOVENIA) 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

(CYPRUS) 

CZECH REPUBLIC 
(DENMARK) 
HUNGARY 
(ICELAND) 

(ITALY) 

(LITHUANIA) 

(NORWAY) 

(RUSSIAN FEDERATION) 
(SLOVENIA) 

SWEDEN 

SWITZERLAND 


DATA NOT 
AVAILABLE 


(GERMANY)* 

(NETHERLANDS) 


(GERMANY)* 

(NETHERLANDS) 


(GERMANY)* 

(NETHERLANDS) 


(FRANCE) 

(GERMANY) 

(NETHERLANDS) 


(UNITED STATES) 


68%itr 


47%ir 


67% 


24%^ 


INTERNATIONAL 

AVERAGE 


63% 


42% 


67% 


1 3% 




Table A5.20— (Continued) 



COMPARISON 
TO THE U.S. ON 
THE FACTOR 


PERCENTAGE WHO 
WERE THREATENED 
AT SCHOOL IN THE 
MONTH PRIOR TO 
TIMSS 


AVERAGE HOURS OF 
TV OR VIDEO 
WATCHING ON A 
NORMAL SCHOOL 
DAY 


AVERAGE HOURS 
AT A PAID 

JOB ON A NORMAL 
SCHOOL DAY 


PERCENTAGE WHO 
WORK ONE OR 
MORE HOURS AT A 
PAID JOB ON A 
NORMAL 
SCHOOL DAY 


ABOVE U.S. 
ON THIS 
FACTOR 


(SOUTH AFRICA) 


CZECH REPUBLIC 

HUNGARY 

(LITHUANIA) 

(NETHERLANDS) 

NEW ZEALAND 

(RUSSIAN FEDERATION) 


NONE 


NONE 


SAME AS U.S. 
ON THIS 
FACTOR 


(AUSTRALIA) 

(CYPRUS) 

CZECH REPUBLIC 

(DENMARK) 

NEW ZEALAND 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

(CYPRUS) 

(DENMARK) 

(ICELAND) 

(NORWAY) 

SWEDEN 


NONE 


NONE 


BELOW U.S. 
ON THIS 
FACTOR 


(AUSTRIA) 

(CANADA) 

(ICELAND) 

(ITALY) 

(LITHUANIA) 

(NORWAY) 

(RUSSIAN FEDERATION) 

(SLOVENIA) 

SWEDEN 

SWITZERLAND 


(FRANCE) 

(ITALY) 
(SLOVENIA) 
(SOUTH AFRICA) 

SWITZERLAND 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

(CYPRUS) 

CZECH REPUBLIC 

(DENMARK) 

(FRANCE) 

(ICELAND) 

(ITALY) 

(LITHUANIA) 

(NETHERLANDS) 

NEW ZEALAND 
(NORWAY) 

(RUSSIAN FEDERATION) 

(SLOVENIA) 

(SOUTH AFRICA) 

SWEDEN 

SWITZERLAND 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

(CYPRUS) 

CZECH REPUBLIC 

(DENMARK) 

(FRANCE) 

(ICELAND) 

(ITALY) 

(LITHUANIA) 

(NETHERLANDS) 

NEW ZEALAND 
(NORWAY) 

(RUSSIAN FEDERATION) 
(SLOVENIA) 

(SOUTH AFRICA) 

SWEDEN 

SWITZERLAND 


DATA NOT 
AVAILABLE 


(FRANCE) 

(GERMANY) 

HUNGARY 

(NETHERLANDS) 


(GERMANY) 


(GERMANY) 

HUNGARY 


(GERMANY) 

HUNGARY 


(UNITED STATES) 


!!%★ 


1.7 HOURS 


3.1 HOURS^ 


61%* 


INTERNATIONAL 

AVERAGE 


7% 


1.7 HOURS 


1 .2 HOURS 


28% 



★ U.S. average is significantly different fron^ the international average. 



NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

International average is the average of the national figures. 

Bold: Nations that performed above the U.S. in both mathematics and science general knowledge. 

Bold Italic: Nations that performed above the U.S. in mathematics general knowledge onlv. 

Regular: Nations that performed similar to the U.S. in mathematics and science general knowledge. 

Italic Nations that performed below the U.S. in both mathematics and science general knowledge. 

* Because this factor concerns science general knowledge, and because these nations performed similar 

to the U.S. in science, they are not bolded for this factor. 



SOURCE: Mullis et al. (1998). Mathematics and Science Achievement in the Final Year of Secondary School. Chestnut 
Hill, MA: Boston College. 
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Table A5.21 

Responses to Selected Student Questionnaire Items: 

Responses of Students Participating in Advanced Mathematics Assessment 



COMPARISON 
TO THE U.S. ON 
THE FACTOR 


PERCENTAGE WHO 
ARE ASSIGNED 
MATHEMATICS 
HOMEWORK 3 OR 
MORE TIMES PER 
WEEK' 


PERCENTAGE WHO 
USE A CALCULATOR 
AT SCHOOL, HOME 
OR ANYWHERE ELSE 
“DAILY” 


PERCENTAGE WHO 
USED A 

CALCULATOR ON 
THE TIMSS 
ADVANCED 
MATHEMATICS 
ASSESSMENT 


PERCENTAGE WHO 
RECEIVE 5 HOURS 
OR MORE OF 
MATHEMATICS 
INSTRUCTION PER 
WEEK' 


NATION 
ABOVE U.S. 
ON THIS 
FACTOR 


(CYPRUS) 


(AUSTRALIA) 

(DENMARK) 

SWEDEN 


CANADA 

(DENMARK) 

SWEDEN 

SWnZERLAND 


(AUSTRALIA) 

CANADA 

(CYPRUS) 

FRANCE 

GREECE 

(LITHUANIA) 

(RUSSIAN FEDERATION) 


NATION 
SAME AS U.S. 
ON THIS 
FACTOR 


(AUSTRALIA) 

CANADA 

GREECE 

(RUSSIAN FEDERATION) 


CANADA 

(CYPRUS) 

FRANCE 


(AUSTRALIA) 

(AUSTRIA) 

CZECH REPUBLIC 

FRANCE 

(GERMANY) 


(AUSTRIA) 

SWITZERLAND 


NATION 
BELOW U.S. 
ON THIS 
FACTOR 


(AUSTRIA) 

CZECH REPUBLIC 

(DENMARK) 

(ITALY) 

(LITHUANIA) 

(SLOVENIA) 

SWEDEN 

SWITZERLAND 


(AUSTRIA) 

CZECH REPUBLIC 
(GERMANY) 

GREECE 

(ITALY) 

(LITHUANIA) 

(RUSSIAN FEDERATION) 

(SLOVENIA) 

SWnZERLAND 


(CYPRUS) 

GREECE 

(ITALY) 

(LITHUANIA) 

(RUSSIAN FEDERATION) 
(SLOVENIA) 


CZECH REPUBLIC 

(DENMARK) 

(ITALY) 

(SLOVENIA) < 

SWEDEN 


DATA NOT 
AVAILABLE 


FRANCE 

(GERMANY) 






(GERMANY) 


(UNITED STATES) 


90%^ 


B2%# 


86%* 


12%* 


INTERNATIONAL 

AVERAGE 


65% 


70% 


76% 


39% 



Notes for this table can be found at the end of table. 



How to read this table: Columns represent responses to particular questionnaire items. The first three rows 
show how each nation's students responded in comparison with U.S. students on that Item. The style of the font for 
the country names indicates how students in that country performed on the general knowledge assessment relative 
to the U.S. For example, the first column represents student responses to whether they were assigned mathematics 
homework 3 or more times per week. The first row in the first column lists the one country in which a higher per- 
centage of students than in the U.S. reported that they were assigned mathematics homework 3 or more times a 
week. The second row in the first column lists the 4 nations in which a similar percentage of students as the U.S. 
reported that they were assigned mathematics homework 3 or more times a week. The third row in the first column 
lists the 8 nations in which a lower percentage of students than in the U.S. reported that they were assigned mathe- 
matics homework 3 or more times a week. 




Table A5.21 - (continued) 



COMPARISON 
TO THE U.S. ON 
THE FAaOR 


PERCENTAGE WHO ARE ASKED 
TO USE COMPUTERS TO SOLVE 
MATHEMATICS EXERCISES OR 
PROBLEMS IN AT LEAST SOME 
MATHEMATICS CLASSES^ 


PERCENTAGE WHO ARE 
ASKED TO DO AT LEAST ONE 
REASONING TASK 
IN "EVERY MATHEMATICS 
LESSON”' 


PERCENTAGE WHO ARE 
ASKED TO APPLY 
MATHEMATICS TO EVERYDAY 
PROBLEMS IN THEIR 
MATHEMATICS LESSONS' 


NATION 
ABOVE U.S. 
ON THIS 
FACTOR 


(CYPRUS) 

(ITALY) 

(SLOVENIA) 


(CYPRUS) 

GREECE 


NONE 


NATION 
SAME AS U.S. 
ON THIS 
FACTOR 


(AUSTRALIA) 

(DENMARK) 

GREECE 


(AUSTRALIA) 

CZECH REPUBLIC 
(ITALY) 

SWEDEN 


(AUSTRALIA) 

CANADA 


NATION 
BELOW U.S. 
ON THIS 
FACTOR 


(AUSTRIA) 

CANADA 
CZECH REPUBLIC 
FRANCE 
(GERMANY) 

(LITHUANIA) 

(RUSSIAN FEDERATION) 

SWEDEN 

SWITZERLAND 


(AUSTRIA) 

CANADA 

(DENMARK) 

FRANCE 

(GERMANY) 

(LITHUANIA) 

(RUSSIAN FEDERATION) 

(SLOVENIA) 

SWITZERLAND 


(AUSTRIA) 

(CYPRUS) 

CZECH REPUBLIC 
(DENMARK) 

FRANCE 

(GERMANY) 

GREECE 

(ITALY) 

(LITHUANIA) 

(RUSSIAN FEDERATION) 
(SLOVENIA) 

SWEDEN 

SWIHERLAND 


DATA NOT 
AVAILABLE 








(UNITED STATES) 


34%^ 


43%* 


85%* 


INTERNATIONAL 

AVERAGE 


28% 


32% 


68% 



★ U.S. average is significantly different from the international average. 

1. Percentage based only on those students who reported that they were currently taking mathematics. 

2. Percentage is based on all students concerning the current or the most recent mathematics course taken. 



NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

International average is the average of the national figures. 

Bold: Nations that performed above the U.S. advanced mathematics students on the advanced mathematics 

assessment. 

Regular: Nations that performed similar to the U.S. advanced mathematics students on the advanced 

mathematics assessment. 

SOURCE: Mullis et al. (1998). Mothemot/cs ond Sdence Achievement /n the Final Year afSecandary SchaaL Chestnut 
Hill, MA: Boston College. 
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Table A5.22 

Responses to Selected Student Questionnaire Items: 
Responses of Students Participating in Physics Assessment 



COMPARISON 
TO THE U.S. ON 
THE FACTOR 


PERCENTAGE WHO 
RECEIVE PHYSICS 
HOMEWORK 3 OR 
MORE TIMES PER 
WEEK* 


PERCENTAGE WHO 
USE A CALCULATOR 
AT SCHOOL. HOME 
OR ANYWHERE ELSE 
"DAILY” 


PERCENTAGE WHO 
USED A 

CALCULATOR ON 
THE TIMSS PHYSICS 
ASSESSMENT 


PERCENTAGE WHO 
CURRENTLY RECEIVE 
5 HOURS OR MORE 
OF PHYSICS 
INSTRUCTION PER 
WEEK* 


NATION 
ABOVE U.S. 
ON THIS 
FACTOR 


(CANADA) 

(CYPRUS) 

GREECE 

NORWAY 

(RUSSIAN FiDERAnON) 


(AUSTRAUA) 

(CANADA) 

(CYPRUS) 

(DENMARK) 

NORWAY 

SWEDEN 


(AUSTRALIA) 

(CANADA) 

(DENMARK) 

NORWAY 

SWEDEN 

SWITZERLAND 


(CANADA) 


NATION 
SAME AS U.S. 
ON THIS 
FACTOR 


(AUSTRALIA) 

(DENMARK) 


FRANCE 

(GERMANY) 

(SLOVENIA) 

SWITZERLAND 


(CYPRUS) 

CZECH REPUBLIC 
FRANCE 
(GERMANY) 
(SLOVENIA) 


(AUSTRALIA) 

(LATVIA) 

(RUSSIAN FEDERATION) 


NATION 
BELOW U.S. 
ON THIS 
FACTOR 


(AUSTRIA) 

CZECH REPUBUC 

(GERMANY) 

(LATVIA) 

(SLOVENIA) 

SWEDEN 

SWITZERLAND 


(AUSTRIA) 

CZECH REPUBLIC 

GREECE 

(LATVIA) 

(RUSSIAN FEDERATION) 


(AUSTRIA) 

GREECE 

(LATVIA) 

(RUSSIAN FEDERATION) 


(CYPRUS) 

CZECH REPUBLIC 

(DENMARK) 

(GERMANY) 

GREECE 

NORWAY 

(SLOVENIA) 

SWEDEN 

SWITZERLAND 


DATA NOT 
AVAILABLE 


FRANCE 






(AUSTRIA) 

FRANCE 


(UNITED STATES) 


51 %★ 


79%^ 


81% 


17%^ 


INTERNATIONAL 

AVERAGE 


40% 


73% 


79% 


8% 



Notes for this table can be found at the end of table. 

How to read this table: Columns represent responses to particular questionnaire items. The first three rows show 
how each nation's students responded in comparison with U.S. students on that item. The style of the font for the 
country names indicates how students in that country performed on the general knowledge assessment relative to the 
U.S. For example, the first column represents student responses to whether they were assigned physics homework 3 
or more times per week. The first row in the first column lists the 5 countries in which a higher percentage of stu- 
dents than in the U.S. reported that they were assigned physics homework 3 or more times a week. The second row 
in the first column lists the 2 nations In which a similar percentage of students as the U.S. reported that they were 
assigned physics homework 3 or more times a week. The third row In the first column lists the 7 nations in which a 
lower percentage of students than in the U.S. reported that they v^re assigned physics homework 3 or more times a 
v^ek. 
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Table A5.22-(continued) 



COMPARISON 
TO THE U.S. ON 
THE FACTOR 


PERCENTAGE WHO ARE 
ASKED TO USE COMPUTERS 
TO SOLVE PHYSICS 
EXERCISES OR PROBLEMS IN 
SOME LESSONS* 


PERCENTAGE WHO ARE 
ASKED TO DO AT LEAST ONE 
REASONING TASK IN "EVERY 
PHYSICS LESSON"* 


PERCENTAGE WHO ARE 
ASKED TO CONDUCT 
LABORATORY EXPERIMENTS 
DURING SOME PHYSICS 
LESSONS* 


NATION 
ABOVE U.S. 
ON THIS 
FACTOR 


(SLOVENIA) 


(CYPRUS) 


NONE 


NATION 
SAME AS U.S. 
ON THIS 
FACTOR 


(CANADA) 

(CYPRUS) 

(DENMARK) 

FRANCE 

GREECE 


CZECH REPUBLIC 

FRANCE 

GREECE 


(CYPRUS) 

(DENMARK) 

FRANCE 

NORWAY 

SWEDEN 


NATION 
BELOW U.S. 
ON THIS 
FACTOR 


(AUSTRALIA) 

(AUSTRIA) 

CZECH REPUBUC 
(GERMANY) 

(LATVIA) 

NORWAY 

(RUSSIAN FEDERATION) 

SWEDEN 

SWITZERLAND 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

(DENMARK) 

(GERMANY) 

(LATVIA) 

NORWAY 

(RUSSIAN FEDERATION) 
(SLOVENIA) 

SWEDEN 

SWITZERLAND 


(AUSTRALIA) 

(AUSTRIA) 

(CANADA) 

CZECH REPUBLIC 
(GERMANY) 

GREECE 

(LATVIA) 

(RUSSIAN FEDERATION) 

(SLOVENIA) 

SWITZERLAND 


DATA NOT 
AVAILABLE 








(UNITED STATES) 


42%^ 


36%^ 


96%^ 


INTERNATIONAL 

AVERAGE 


29% 


23% 


79% 



'k U.S. average is significantly different from the international average. 

* Percentage based only on those students who reported that they were currently taking physics. 



NOTES: 

Nations not meeting international sampling and other guidelines are shown in parentheses. See Appendix I for 
details for each country. 

International average Is the average of national figures. 

Bold: Nations that performed above the U.S. physics students on the physics assessment 

Regular: Nations that performed similar to the U.S. physics students on the physics assessment 



SOURCE: Mullis et al. (1998). Alothemot/cs and Sdence Achievement in the Final Year of Secondary School. Chestnut 
Hill. MA: Boston College. 




135 



APPENDIX 6 



ADVISORS TO THE U.S. TIMSS STUDY 




13G 



William Schmidt — Chair 
U.S. TIMSS National Research 
Coordinator 

Michigan State University 
Gordon Ambach 

Council of Chief State School Officers 

Deborah Ball 
University of Michigan 

Audrey Champagne 
SUNY University at Albany 

David Cohen 
University of Michigan 

John Dossey 
Illinois State University 

Emerson Elliott 

National Council for Accreditation of 
Teacher Education 

Sheldon Glashow 
Harvard University 

Larry Hedges 
University of Chicago 

Henry Heikkinen 

University of Northern Colorado 

Jeremy Kilpatrick 
University of Georgia 



Marcia Linn 

University of California at Berkeley 

Robert Linn 
University of Colorado 

Paul Sally 

The University of Chicago 

Richard Shavelson 
Stanford University 

Bruce Spencer 
Northwestern University 

Elizabeth Stage 

University of California at Berkeley 

James Taylor 
Global M 

Kenneth Travers 
University of Illinois 

Paul Williams 
University of Wisconsin 



Mary Lindquist 
Columbus State University 




137 




A PPENDIX 7 

ADDITIONAL TIMSS REPORTS 





138 



Ordering information for each of the 
following publications is located at the 
end of this appendix. 

Asterisks indicate that the publication is 
included in Attaining Excellence: A TIMSS 
Resource Kit. 

HOW CAN EDUCATORS, 
PRACTITIONERS, POLICYMAKERS, 
AND CONCERNED CITIZENS 
REFLECT UPON THEIR OWN 
LOCAL PRACTICES IN LIGHT OF 
TIMSS FINDINGS? 

Attaining Excellence: A TIMSS Resource 
Kity September 1997 -This comprehen- 
sive package includes four modules 
which contain the following items: 
reports on the TIMSS findings; video- 
tapes of classroom teaching in the 
United States, Japan, and Germany; 
guides for discussion leaders; presenta- 
tion overheads with talking points for 
speakers; checklists, leaflets, and flyers. 
Note that the Kit’s twelve publications 
and two videos include several items 
that are available individually elsewhere 
on this list. Those publications are 
denoted by an asterisk in the margin. 
$94. GPO Stock #065-000-01013-5. 

To order, contact: Superintendent of 
Documents. Also may be downloaded 
from http://timss.enc.org. 

WHERE CAN I FIND A GOOD 
SUMMARY OF TIMSS FINDINGS 
THAT PUTS U.S. EDUCATION IN 
COMPARATIVE PERSPECTIVE? 

* Pursuing Excellence: A Study of U.S. 
Fourth-Grade Mathematics and Science 
Achievement in International Context^ June 
1997 -This report summarizes the most 
important findings concerning U.S. 



achievement and schooling in the fourth 
grade. Paperback, 68 pp. $4.75. GPO 
Stock #065-000-01018-6. 

To order, contact: Superintendent of 
Documents. Also may be downloaded 
from: http://nces.ed.gov/timss. 

^Pursuing Excellence: A Study of U.S. Eighth- 
Grade Mathematics and Science Teaching, 
Learning, Curriculum, and Achievement in 
International Context, November 1996 - 
This report draws from the assessments, 
surveys, video, and case studies of 
TIMSS to summarize the most important 
findings concerning U.S. achievement 
and schooling in the eighth grade. 
Paperback, 80 pp. $9.50. GPO Stock 
#065-000-00959-5. 

To order, contact: Superintendent of 
Documents. Also may be downloaded 
from http://nces.ed.gov/timss. 

WHERE CAN I FIND A DETAILED 
INTERNATIONAL COMPARISON OF 
FOURTH-GRADE STUDENTS? 

Mathematics Achievement in the Primary 
School Years: lEA’s Third International 
Mathematics and Science Study (TIMSS), 
June 1997 - This report focuses on third- 
and fourth-grade mathematics achieve- 
ment in 26 countries, including back- 
ground information about students and 
teachers. Paperback, 184 pp. + 52 pp. 
^pendix. $20.00 (+ $5.00 shipping 8c 
handling, if international). 

To order, contact: TIMSS International 
Study Center. Also may be downloaded 
from: http://wwwcsteep.bc.edu/TIMSSl / 
TIMSSPublications.html#Intemational. 
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Science Achievement in the Primary School 
Years: lEA^s Third International Mathemat- 
ics and Science Study (TIMSS),June 1997 - 
This report focuses on third- and fourth- 
grade science achievement in 26 
countries, including background infor- 
mation about students and teachers. 
Paperback, 148 pp. + 52 pp. Appendix. 
$20.00 (+ $5.00 shipping 8c handling if 
international). 

To order, contact: TIMSS International 
Study Center. Also may be downloaded 
from: http://wwwcsteep.bc.edu/TIMSSl/ 
TIMSSPublications.html#Intemational. 



WHERE CAN I FIND A DETAILED 
INTERNATIONAL COMPARISON 
OF EIGHTH-GRADE STUDENTS? 

*Mathematics Achievement in the Middle 
School Years: lEA^s Third International 
Mathematics and Science Study (TIMSS), 
November 1996 - This report focuses on 
seventh- and eighth-grade mathematics 
achievement in 41 countries, including 
background information about students 
and teachers. Paperback, 176 pp. -h 60 
pp. >^)pendix. $30 (+$5.00 shipping and 
handling if international). GPO Stock 
#065-000-01023-2. 

To order, contact: TIMSS International 
Study Center or Superintendent of Doc- 
uments. Also may be downloaded from: 
http://wwwcsteep.bc.edu/TIMSSl/TI 
MSSPublications.html#International. 

^Science Achievement in the Middle School 
Years: lEA^s Third International 

Mathematics and Science Study (TIMSS), 
November 1996 - This report focuses on 
seventh- and eighth-grade science 
achievement in 41 countries, including 
background information about students 
and teachers. Paperback, 168 pp. + 62 



pp. Appendix. $30 (+$5.00 shipping 
and handling if international). GPO 
Stock #065-000-01023-2. 

To order, contact: TIMSS International 
Study Center or Superintendent of 
Documents. Also may be downloaded 
from: http:/ / wwwcsteep.bc.edu/TIMSSl / 
TIMSSPublications.html#Intemational. 



WHERE CAN I FIND A DETAILED 
INTERNATIONAL COMPARISON 
OF TWELFTH-GRADE STUDENTS? 

Mathematics and Science Achievement in 
the Final Year of Secondary School: lEA^s 
Third International Mathematics and 
Science Study (TIMSS) February 1998 - 
This report focuses on mathematics and 
science achievement in 24 countries at 
the end of secondary school, including 
background information about students 
and teachers. Paperback, 236 pp. + 105 
pp. Appendix. $30 (+$5.00 shipping and 
handling if international). 

To order, contact: TIMSS International 
Study Center. Also may be downloaded 
from: h ttp:/ / wwwcsteep.bc.edu/TIMSS 1 / 
TIMSSPublications.html#Intemational. 



WHERE CAN I OBTAIN THE 
COMPLETE TIMSS INTERNATIONAL 
DATABASE IN ORDER TO 
PERFORM SECONDARY ANALYSIS? 

TIMSS International Database - The data- 
base contains achievement scores in 
mathematics and science for those coun- 
tries that participated in TIMSS at the 
third- and fourth grades (Population 1) 
and the seventh- and eighth grades 
(Population 2), and questionnaire 
results for students, teachers, and prin- 
cipals. The database can be used with 



either SAS or SPSS software. 
Accompanied by User Guidebook. 

The TIMSS International Database is 
available on CD-ROM from the lEA 
Secretariat. It is provided in ASCII for- 
mat and may also be downloaded from: 
http://wwwcsteep.bc.edu/ timssl/ data- 
base. html 

The Population 3 Database and User 
Guide will be available June 1998. 



HOW CAN I GET A FIRST-HAND 
GLIMPSE OF ACTUAL CLASSROOM 
LESSONS IN THE U.S., GERMANY, 
AND JAPAN? 

"^E^th-Grade Mathematics LessoTis: United 
States, Japan, and Germany - An 80- 
minute VHS tape with abbreviated ver- 
sions of six eighth-grade mathematics 
lessons: one algebra and one geometry 
lesson each from the United States, 
Japan, and Germany, GPO Stock #065- 
000-01025-9, $20. 



WHERE CAN I COMPARE 
STUDENTS' PERFORMANCE ON A 
SERIES OF PRACTICAL TASKS IN 
BOTH MATHEMATICS AND 
SCIENCE? 

Performance Assessment in lEA^s Third 
International Mathematics and Science 
Study, 1997 - The regular TIMSS assess- 
ments were supplemented by hands-on 
performance assessments which mea- 
sured 4th- and 8th-grade students’ con- 
tent and procedural knowledge, as well 
as their ability to use that knowledge in 
reasoning and problem solving. 
Students in 21 countries participated, 
making it the largest international per- 
formance assessment yet conducted. 
This report includes findings from the 
21 countries and descriptions of the per- 
formance tasks. Paperback, 128 pp. + 
45 pp. Appendix. 

To order, contact: TIMSS International 
Study Center. Also may be downloaded 
from http:/ /wwwcsteep.bc.edu/TIMSSl 
/PAreporthtml. 



To order, contact: Superintendent of 
Documents. 

CD-ROM Video Examples from the 
TIMSS Videotape Classroom Study: 
Eighth-Grade Mathematics in Germany, 
Japan, and the United States - Actual 
episodes in eighth-grade mathematics 
classes let viewers see an abbreviated 
geometry and algebra lesson in each of 
three countries: Germany, Japan, and 
the U.S. 

To order, contact: Superintendent of 
Documents. 

Minimum System Requirements: 

IBM PC or 100% compatible, MS 
Windows® (Windows 95® recommend- 
ed), Pentium® (16 MB of RAM, 256 
color SVGA or better, 2x or higher CD- 
ROM drive, Sound Card. 

HOW CAN I LEARN MORE ABOUT 
THE LIVES OF STUDENTS AND 
TEACHERS IN THE U.S., JAPAN, 
AND GERMANY? 

Contemporary Research in the United 
States, Germany, and Japan on Five 
Education Issues: Structure of the 

Education System; Standards in Education; 
The Role of School in Adolescents^ Lives; 
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Individual Differences Among Students^ 
and Teachers^ Lives, 802 pp. |50. 

The Education System in Germany: Case 
Study Findings. 406 pp. $25. 

The Education System in Japan: Case Study 
Findings. 412 pp. $25. 

The Education System in the United States: 
Case Study Findings. 341 pp. $20. 

To Sum It Up: Case Studies of Education in 
Germanyy Japan, and the United States. 166 
pp. $10. (Shipping and handling, $5) 

To order, contact: University of Michigan. 

WHERE CAN I FIND OUT WHAT 
TIMSS HAS LEARNED ABOUT 
CURRICULUM? 

A Splintered Vision: An Investigation of US. 
Science and Mathematics Education, 1997 - 
This book enunciates the argument that 
math and science curricula in U.S. 
schools suffer from a lack of focus. The 
authors contend that in their effort to 
canvas as many topics as possible, both 
teachers and textbook publishers fail to 
delve into the most important subjects 
with sufficient depth. 176 pp. Hardback 
ISBN: 0-7923-4440-5, $87; Paperback 
ISBN: 0-7923-4441-3, $49 

To order, contact: Kluwer Academic 
Publishers Group. 

Many Visions, Many Aims: Volume 1, A 
Cross-National Exploration of Curricular 
Intentions in School Mathematics, 1997 - An 
analysis of mathematics curriculum 
guides and textbooks in 50 countries. 
This report looks at the sequence and the 
topics covered from kindergarten 
through the end of secondary school, ana- 
lyzed in a comparative framework. 286 



pp. Hardback ISBN: 0-79234436-7, $120; 
Paperback ISBN: 0-79234437-5, $55 . 

To order, contact: Kluwer Academic 
Publishers Group. 

Characterizing Pedagogical Flow: An 
Investigation of Mathematics and Science 
Teaching in Six Countries, 1996 - 
Describes the results of the Study of 
Mathematics and Science Opportunity 
(SMSO) survey, which investigated cur- 
riculum content and instructional meth- 
ods in France, Japan, Norway, Spain, 
Switzerland, and the United States, 
using case studies in each participating 
country. 229 pp. Hardback ISBN: 
0792342720, $110; Paperback ISBN: 
0792342739, $49 

To order, contact: Kluwer Academic 
Publishers Group. 

TIMSS Monograph Series No. 3 
Mathematics Textbooks: A Comparative 
Study of Grade 8 Texts, 1 995 - An exami- 
nation of eight mathematics textbooks 
for 13-year-olds for their pedagogical 
and philosophical similarities and dif- 
ferences. Texts are from the United 
States, the Netherlands, the United 
Kingdom, Norway, Spain, France, 
Switzerland, and Japan. Paperback, 96 
pp. ISBN: 1-895766-03-6. $16.95. 

To order, contact: Pacific Educational 
Press. 

WHERE CAN I FIND OUT MORE 
ABOUT THE METHODOLOGY 
OF TIMSS? 

Third International Mathematics and 
Science Study: Quality Assurance in Data 
Collection, 1996 - A report on the quality 
assurance program which ensured the 
comparability of results across partici- 
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pating countries. The program empha- 
sized instrument translation and adapta- 
tion, sampling response rates, test 
administration and data collection, the 
reliability of the coding process, and the 
integrity of the database. Paperback, 93 
pp. + 91 pp. Appendix. 

To order, contact: TIMSS International 
Study Center. Also may be downloaded 
from: http://wwwcsteep.bc.edu/TIMSSl/ 
TIMSSPublications.html#Intemational. 

Third International Mathematics and 
Science Study: Technical Report, Volume 1 
Design and Development, 1996 - This 
report describes the study, design, and 
the development of TIMSS up to, but 
not including, the operational stage of 
main data collection. Paperback, 149 
pp. + 40 pp. Appendix. 

To order, contact: TIMSS International 
Study Center. Also may be downloaded 
from: http://wwwcsteep.bc.edu/TIMSSl/ 
TIMSSPublications.html#Intemational. 

TIMSS Monograph Series No, I, Curri- 
culum Frameworks for Mathematics and 
Science, 1993 - This monograph explains 
the study’s foci and its key first step - the 
development of the curriculum frame- 
works that served as the guide for 
designing the study’s achievement tests. 
The frameworks are included in the 
appendices. Paperback, 102 pp. ISBN: 
0-88865-090-6. $16.95. 

To order, contact: Pacific Educational 
Press. 

TIMSS Monograph Series No. 2 Research 
Questions and Study Design, 1996 - This 
monograph presents the study’s research 
objectives along with discussions that 
include: the impact of prior studies on the 
design of TIMSS; how the research ques- 
tions were derived from TIMSS’ concep- 



tual framework; and how the research 
questions and test items were tailored to 
meet the contexts of the participating 
coimtries. Paperback, 112 pp. ISBN: 1- 
8957664)2-S. $17.95. 

To order, contact: Pacific Educational 
Press. 

WHERE CAN I READ THE ACTUAL 
TEST ITEMS GIVEN TO STUDENTS? 

TIMSS Mathematics Items Released Set for 
Population 1 (Third and Fourth Grades) - 
All publicly released items used to assess 
third- and fourth-grade students in the 
TIMSS study. Paperback, 98 pp. $20.00 
(+ $5.00 shipping Sc handling, if 
international). 

TIMSS Science Items Released Set for 
Population 1 (Third and Fourth Grades) - 
All publicly released items used to assess 
third- and fourth-grade students in the 
TIMSS study. Paperback, 84 pp. $20.00 
(+ $5.00 shipping Sc handling, if 
international). 

TIMSS Mathematics Items Released Set for 
Population 2 (Seventh and Eighth Grades) 

- All publicly released items used to 
assess seventh- and eighth-grade stu- 
dents in the TIMSS study. Paperback, 
142 pp. $20.00 (+ $5.00 shipping Sc han- 
dling, if international). 

TIMSS Science Items Released Set for 
Population 2 (Seventh and Eighth Grades) 

- All publicly released items used to 
assess seventh- and eighth-grade stu- 
dents in the TIMSS study. Paperback, 
127 pp. $20.00 (+ $5.00 shipping 5c han- 
dling, if international). 

TIMSS Mathematics and Science Items 
Released Set for Population 3 (End of 
Secondary School) - All publicly released 
items used to assess students in their 
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final year of schooling in the TIMSS 
study. Paperback. 

To order, contact: TIMSS International 
Study Center. Also may be downloaded 
from: http://wwwcsteep.bc.edu/TIMSSl/ 
TIMSSPublications.html#Intemational. 

HOW CAN I FIND OUT MORE 
ABOUT EDUCATION IN VARIOUS 
TIMSS COUNTRIES? 

National Contexts for Mathematics and 
Science Education: An Encyclopedia of the 
Education Systems Participating in TIMSS, 
1997 - Each participating country’s edu- 
cation system is discussed in a separate 
chapter, considering geographic and 
economic influences, school gover- 
nance, teacher education, and curricu- 
lum. Hardback, 423 pp. $75. 

To order, contact: Pacific Educational 
Press. 

CONTACT INFORMATION: 

Superintendent of Documents 
P.O. Box 371954 
Pittsburgh, PA 15250-7954 
Telephone: (202) 512-1800 
Fax: (202) 512-2250. 

TIMSS International Study Center 
Center for the Study of Testing, 
Evaluation, and Educational Policy 
(CSTEEP) Campion Hall Room 323 
School of Education, Boston College 
Chestnut Hill, MA 02167; 

Telephone: (617) 552-4521; 

Fax: (617) 552-8419; 

Email: timss@bc.edu; 

Internet: http://wwwcsteep.bc.edu. 



The lEA Secretariat 
Herengracht 487 
1017 BT Amsterdam 
The Netherlands; 

Telephone: +31 20 625 36 25; 

Fax: +31 20 420 71 36; 

E-mail: Department@IEA.nl. 

Kluwer Academic Publishers Group 
Order Department 
P.O. Box 358, Accord Station 
Hingham, MA 02018-0358; 

Telephone: (617) 871-6600; 

Fax (617) 871-6528; 

Email: kluwer@wkap.com; 

Internet: http://www.wkap.nl or 
http:/ / ustimss.msu.edu/ publicat.htm. 

Pacific Educational Press 
Faculty of Education 
University of British Columbia 
Vancouver, Canada V6T 1Z4; 
Telephone: (604) 822-5385; 

Fax: (604) 822-6603; 

Email: cedwards@interchange.ubc.ca. 

University of Michigan 

Attn: Suyin Liang 

Center for Human Growth and 

Development 

300 N. Ingalls, 10th Floor 

Ann Arbor, MI 48109-0406 

Telephone: (734) 764-2443 

(Please make checks payable to “The 

University of Michigan.”) 
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